Skip to main content

VSTS Tester 2010 Mark Mydland Heartland Tour (CONDG)

Jennifer Marsman, one of our beloved Heartland District Developer Evangelists, arranged for Mark Mydland, Principle Group Manager with Microsoft in Redmond for the VSTS Tester Edition to tour our area and deliver a presentation on VSTS Tester 2010. This also doubled as the November Central Ohio .Net User Group (CONDG) meeting. Thanks, Microsoft for the food and swag.

Along with some great product development stories, Mark highlighted the following:

Playback - often, the written repro scenario provided along with the defect isn't clear (if it even exists). This feature enables developers and other roles to watch a video of the functional / UI test from the Tester live, in action.

Test Case vs. Actual Capture - for manual tests, a list of steps involved with the test can be compared to what steps the tester actually took.

Work Item Categories - classify a work item type into categories with one work item serving as the default.

Cut/paste screen shots - easy to [Alt]+[Prnt Scrn] and paste a defect screen shot into a TFS defect work item.

Testing Activity Center - a UI for the layperson tester. No Visual Studio...just a lightweight app to manage test cases and iterations, execute automated tests, and manage defects.

Thread Debugger Agent - from within the playback for a test case, you can step through the code. It only works with events in the CTP but it will include methods and properties for RTM. It works by attaching to CLR profiler, registering for events and then logging them to the test case/defect. This is tied to a specific version of the asset stored within TFS. Wow.

Distributed Test - agents run as Windows services assigned to a single controller to execute and instrument (collect data metrics) distributed testing scenarios. Included in this instrumentation, called Data and Diagnostics, can concurrently capture things such as the Event Log, System Information, custom logging files, PDBs, and even a video recording. Each agent may possess configuration elements to accommodate environmental differences e.g dev/test/staging...different database connection, etc. 

PEX - this is a tool which while available in 2010, is downloadable for 2008 from the link. This neat feature executes your methods and recursively discovers all the code paths. It does this by throwing varying values and types at your method attributes e.g. nulls, strings, etc. This produces a Pex Exploration Results. Then, one can use this to  generate test harness classes leveraging this sample set. Wow.

Chess - Not here for the CTP but it should come online for a future Beta release. Chess sets up test cases and allows you to debug and break on any context change. Chess intercepts requests to the thread scheduler and re-executes them. Using some magic algorithm, Chess continues to execute thread requests in differing order. This helps determine and test if your code is thread-safe and yields the expected outcome regardless of the order in which it was executed.

Coded UI Test - A new test type which will produce managed code based off a UI recorder.

Thanks for visiting, Mark and thanks for bringing such talent to the district, Jennifer!

Comments

Anonymous said…
This comment has been removed by a blog administrator.

Popular posts from this blog

Get Your Team Foundation Server Hate On!

[Google ranking skyrockets... ;-)] I'm a big fan of TFS/VSTS. However, there are a good pocket of folks who take issue with the way TFS handles or implements a certain feature. Well this is your chance to vent! I'm planning a presentation around the "Top 10 TFS/VSTS Hates and How to Alleviate Them"...or something along those lines. But I need your help. Post a comment below detailing your dislike. If it's legitimate, I'll highlight it in the presentation and [hopefully] provide an alternative, resolution, or work-around. Thanks in advance! Update 7/19/2008: Version Control and Microsoft

Rollback a Ooops in TFS with TFPT Rollback

Rhut roe, Raggie. You just checked in a merge operation affecting 100's of files in TFS against the wrong branch. Ooops. Well, you can simply roll it back, right? Select the folder in Source Control Explorer and...hey, where's the Rollback? Rollback isn't supported in TFS natively. However, it is supported within the Power Tools leveraging the command-line TFPT.exe utility. It's fairly straightforward to revert back to a previous version--with one caveot. First, download and install the Team Foundation Power Tools 2008 on your workstation. Before proceeding, let's create a workspace dedicated to the rollback. To "true up" the workspace, the rollback operation will peform a Get Latest for every file in your current workspace. This can consume hours (and many GB) with a broad workspace mapping. To work around this, I create a temporary workspace targeted at just the area of source I need to roll back. So let's drill down on our scenario... I'm worki

Configuring a Development Sandbox for the Azure CTP

I'm getting up to speed on Azure and the other cloud SDKs and need to configure an environment for development, demos and learning. My experiences... First off, if you've read my blog, you know I haven't installed non-productivity software on my core OS for years . Further, I don't get the warm and fuzzies installing CTP software on my core OS. I also love the recoverability and start-over-from-a-checkpoint features of virtualization. Virtual PC (VPC) houses all my development, demo and learning sandbox instances. So, let's start off with a VPC instance. For this to work well, ideally, you need a good 4GB of memory. Further to the ideal, you're running x64 so as to have access to the full 4GB of memory. ACQUIRE AN AZURE SERVICES DEVELOPER KEY To develop against Azure and/or .Net Services and SQL Services, you need an invitation code. Oooh, very exclusive. Pretty people to the front of the line! You can start the process here . If you run into problems, che