BizTalk Benchmark Wizard – New release
The Benchmark Wizard was released earlier this year, and even though we got lots of good feedback we’ve also got requests for some changes.
If you haven’t yet heard about this tool, the purpose of it is to verify your BizTalk environment performs as expected. There are two different scenarios you can run, a Messaging and an Orchestration scenario. Each of the scenarios has been tested on various environments and configuration. The result of these tests has provided the tool with a set of KPI’s, which your test result will be benchmarked against. For more information about the Benchmark Wizard:
Benchmark your BizTalk Server (Part 1) - Overview
Benchmark your BizTalk Server (Part 2) – How to install
Benchmark your BizTalk Server (Part 3) – Drill down and analyse
The most common feedback is related to the fact that it was very difficult to meet the KPI’s. A reason for this is that the original tests where executed while global tracking was disabled. This was unfortunate as the DTA tracking has ~30% overhead. We have done a re-run of all the tests, and updated the KPI’s for the new version (shown at the bottom of this page).
Further more, there seams to be a question of how to interpret the result. What does “Succeeded” mean? Does it reflect the best possible result or good enough? To make this more clear, we’ve implemented the “stop light approach”, where if you’ve Succeeded you should be proud of yourself and make a blog post, while an Acceptable result is nothing to be ashamed of.
There has also been some other fixes such as the resetting all the counters when you re-run the test, and fixing the CPU counters to show correct values.
Special thanks to Microsoft and Ewan Fairweather for letting me use their test lab!
Download BizTalk Benchmark Wizard from CodePlex
Scenario KPI’s: Messaging Single and Multi Message Box
Scenario KPI’s: Orchestration Single Message Box
* Storage: EMC Clarion CX-240 ( 5 solid state drives )