BizTalk Benchmark Wizard – New release

Listen with webReader
Published 23 April 10 02:25 PM | wmmihaa

The Benchmark Wizard was released earlier this year, and even though we got lots of good feedback we’ve also got requests for some changes.

If you haven’t yet heard about this tool, the purpose of it is to verify your BizTalk environment performs as expected. There are two different scenarios you can run, a Messaging and an Orchestration scenario. Each of the scenarios has been tested on various environments and configuration. The result of these tests has provided the tool with a set of KPI’s, which your test result will be benchmarked against. For more information about the Benchmark Wizard:

Benchmark your BizTalk Server (Part 1) - Overview

Benchmark your BizTalk Server (Part 2) – How to install

Benchmark your BizTalk Server (Part 3) – Drill down and analyse

The most common feedback is related to the fact that it was very difficult to meet the KPI’s. A reason for this is that the original tests where executed while global tracking was disabled. This was unfortunate as the DTA tracking has ~30% overhead. We have done a re-run of all the tests, and updated the KPI’s for the new version (shown at the bottom of this page).

Further more, there seams to be a question of how to interpret the result. What does “Succeeded” mean? Does it reflect the best possible result or good enough? To make this more clear, we’ve implemented the “stop light approach”, where if you’ve Succeeded you should be proud of yourself and make a blog post, while an Acceptable result is nothing to be ashamed of.     

 

image

 

There has also been some other fixes such as the resetting all the counters when you re-run the test, and fixing the CPU counters to show correct values.

Special thanks to Microsoft and Ewan Fairweather for letting me use their test lab!

Download BizTalk Benchmark Wizard from CodePlex

Scenario KPI’s: Messaging Single and Multi Message Box

image

Scenario KPI’s: Orchestration Single Message Box

image

 

Test environment:

image

* Storage: EMC Clarion CX-240 ( 5 solid state drives )

Configuration:

Comments

# AutomobilePlanet.com | Pillar Coachwork Design said on April 23, 2010 06:25 PM:

Pingback from  AutomobilePlanet.com | Pillar Coachwork Design

# Twitter Trackbacks for BizTalk Benchmark Wizard ??? New release - Mikael H??kanssons Blog [blogical.se] on Topsy.com said on April 23, 2010 08:33 PM:

Pingback from  Twitter Trackbacks for                 BizTalk Benchmark Wizard ??? New release - Mikael H??kanssons Blog         [blogical.se]        on Topsy.com

This Blog

News

    MVP - Microsoft Most Valuable Professional BizTalk User Group Sweden BizTalk blogdoc

    Follow me on Twitter Meet me at TechEd

    Visitors

    Locations of visitors to this page

    Disclaimer

    The opinions expressed herein are my own personal opinions and do not represent my employer's view in anyway.

Syndication