Blackberry ENTERPRISE SERVER FOR IBM LOTUS DOMINO - - PERFORMANCE BENCHMARKING GUIDE Manual
  1. Manuals
  2. Brands
  3. Blackberry Manuals
  4. Server
  5. ENTERPRISE SERVER FOR MICROSOFT EXCHANGE - - PERFORMANCE BENCHMARKING...
  6. Manual
Blackberry ENTERPRISE SERVER FOR IBM LOTUS DOMINO - - PERFORMANCE BENCHMARKING GUIDE Manual

Blackberry ENTERPRISE SERVER FOR IBM LOTUS DOMINO - - PERFORMANCE BENCHMARKING GUIDE Manual

For ibm lotus domino
Hide thumbs Also See for ENTERPRISE SERVER FOR IBM LOTUS DOMINO - - PERFORMANCE BENCHMARKING GUIDE:
Table of Contents

Advertisement

Quick Links

Download this manual
BlackBerry Enterprise Server for IBM
Lotus Domino
Version 4.1
Performance Benchmarking

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the ENTERPRISE SERVER FOR IBM LOTUS DOMINO - - PERFORMANCE BENCHMARKING GUIDE and is the answer not in the manual?

Questions and answers

Related Manuals for Blackberry ENTERPRISE SERVER FOR IBM LOTUS DOMINO - - PERFORMANCE BENCHMARKING GUIDE

Summary of Contents for Blackberry ENTERPRISE SERVER FOR IBM LOTUS DOMINO - - PERFORMANCE BENCHMARKING GUIDE

  • Page 1 BlackBerry Enterprise Server for IBM Lotus Domino Version 4.1 Performance Benchmarking...
  • Page 2 At the time of publication, this documentation is based on BlackBerry Enterprise Server Version 4.1 for IBM Lotus Domino. ©2006 Research In Motion Limited. All Rights Reserved. The BlackBerry and RIM families of related marks, images, and symbols are the exclusive properties of Research In Motion Limited.
  • Page 3 Research In Motion Limited Research In Motion UK Limited 295 Phillip Street Centrum House, 36 Station Road Waterloo, ON N2L 3W8 Egham, Surrey TW20 9LF Canada United Kingdom Published in Canada...

  • Page 5: Table Of Contents

    Contents Overview ................................9 About this document ............................9 Audience ..............................10 BlackBerry Enterprise Server components ....................11 BlackBerry Dispatcher............................11 BlackBerry Messaging Agent..........................11 BlackBerry Router ............................12 BlackBerry Controller ............................12 BlackBerry MDS Services..........................12 BlackBerry MDS Connection Service ......................13 BlackBerry Attachment Service ........................13 BlackBerry Synchronization Service ......................14...
  • Page 6 Performance testing tools ..........................21 Lotus Mail Driver Agent...........................21 Server.Load scripts ........................... 21 BlackBerry MDS Connection Service Push Load Testing tool ............22 Measurement counters ..........................22 Lab initialization.............................. 22 Performance tests............................... 23 Overview of the performance tests ......................23 IBM Lotus Domino performance test results ....................
  • Page 7 Appendix: MMB and MMB2 comparison ....................... 49 Overview................................49 BlackBerry Attachment Service traffic for MMB2 ................53 Appendix: BlackBerry MDS Connection Service traffic rate derivation ...........55 Message test load traffic ..........................55 BlackBerry MDS Connection Service load traffic..................55 Appendix: Calculations and data........................57...

  • Page 9: Overview

    IBM® Lotus® Domino®. It presents the results of performance testing on the BlackBerry Enterprise Server and describes the impact of the BlackBerry Enterprise Server on an IBM Lotus Domino server and a Microsoft® SQL Server 2000. Finally, this document includes important information for system administrators who are responsible for implementing the BlackBerry Enterprise Solution in an IBM Lotus Domino environment.

  • Page 10: Audience

    BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking Audience This document assumes that you have a working knowledge of the following items: • BlackBerry Enterprise Server for IBM Lotus Domino installation, configuration, administration, and architecture • IBM Lotus Domino R6.5 server installation and administration •...

  • Page 11: Blackberry Enterprise Server Components

    BlackBerry device. If the documents are eligible for delivery to the BlackBerry device, the BlackBerry Messaging Agent retrieves the text content of each document. It sends the first 2 KB of the message to the BlackBerry Dispatcher to be compressed and encrypted, and queues one packet for delivery to the BlackBerry device.

  • Page 12: Blackberry Router

    Controller restarts the BlackBerry Messaging Agent. If the Userdump.exe tool is installed on the computer, the BlackBerry Controller also creates a .dmp file when the BlackBerry Messaging Agent stops responding. The BlackBerry Controller restarts the IBM Lotus Domino service, which in turn starts the NBES process as an add- in task for IBM Lotus Domino.

  • Page 13: Blackberry Mds Connection Service

    The BlackBerry MDS Connection Service also communicates with the BlackBerry Dispatcher. It permits persistent socket connections from the BlackBerry device to the corporate application server. You can configure the BlackBerry MDS Connection Service to run on a computer that is remote from the BlackBerry Enterprise Server computer.

  • Page 14: Blackberry Synchronization Service

    The BlackBerry Synchronization Service synchronizes contacts, tasks, and memos between the email application on a user’s computer and the user’s BlackBerry device using IBM Lotus Domino through the BlackBerry Messaging Agent. The BlackBerry Synchronization Service also synchronizes message settings and message filters. The wireless protocol also synchronizes a variety of database configurations, backs up databases on the BlackBerry device, and synchronizes items when necessary.

  • Page 15: Blackberry Enterprise Server Implementation Considerations

    BlackBerry users. RIM recommends that you place the BlackBerry Enterprise Server as close to the messaging servers as possible and target the messaging servers that host the majority of BlackBerry users. Depending on the WAN infrastructure, you might want to implement a BlackBerry Enterprise Server in more than one site for optimal performance.

  • Page 16: Blackberry Mds Connection Service Traffic

    When implementing the BlackBerry MDS Connection Service, consider both the rate at which data is sent to BlackBerry devices and the amount of transcoding that the data requires. Do not push too much data that requires transcoding to BlackBerry devices when messaging traffic is heavy; doing so might cause message delivery to slow.

  • Page 17: Wireless Enterprise Activation

    Activating BlackBerry devices wirelessly involves pushing content from a user's mailbox to a BlackBerry device that is not connected to a computer. A large amount of data is sent through the BlackBerry Enterprise Server to the BlackBerry device, which results in increased wireless traffic, increased activity by the BlackBerry Enterprise Server, and increased activity by the messaging and collaboration servers.
  • Page 18 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking...

  • Page 19: Test Environment

    The following tables provide information about the various components that RIM used in the performance test environment. In some cases, these components are greater than the minimum requirements established for the BlackBerry Enterprise Server Version 4.1 for IBM Lotus Domino. IBM Lotus Domino server equipment...

  • Page 20: Blackberry Enterprise Server Equipment

    BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking BlackBerry Enterprise Server equipment Type Components hardware 1 Compaq DL360 G3 server with the following features: • Dual Pentium IV 2.8 GHz processors (hyper-threading turned off) • 3920 MB memory •...

  • Page 21: Load Generator Computer Equipment

    IBM Lotus Domino Server.Load tool with custom scripts to generate appointments and meetings, and to respond to meetings load • BlackBerry MDS Connection Service Push Load Testing tool Performance testing tools Performance testing was performed in a single, defined environment using the following testing tools: •...

  • Page 22: Blackberry Mds Connection Service Push Load Testing Tool

    1000 user accounts configured on each IBM Lotus Domino server on which the MMB2 load was applied. To reset the tests to the correct number of BlackBerry user accounts with no message items quickly, RIM restored the information store and the Microsoft SQL database from backup files.

  • Page 23: Performance Tests

    RIM obtained the performance data through a series of tests that were conducted in a controlled environment. Twenty-five tests were run to determine the impact of the BlackBerry Enterprise Server on the IBM Lotus Domino server. The performance tests also displayed the performance characteristics of the BlackBerry Enterprise Server.
  • Page 24 2000 BlackBerry user accounts • 2000 user accounts on 2 IBM Lotus Domino servers • measured the impact of the BlackBerry MDS Collaboration Service load on the BlackBerry Enterprise Server and on the • 500 BlackBerry user accounts Microsoft SQL Server •...
  • Page 25 2000 user accounts on 2 IBM Lotus Domino servers • measured the impact of all benchmarked BlackBerry features enabled at the same time on the BlackBerry Enterprise Server, • 500 BlackBerry user accounts IBM Lotus Domino server, and on the Microsoft SQL Server •...
  • Page 26 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking...

  • Page 27: Ibm Lotus Domino Performance Test Results

    17, which had no impact on the IBM Lotus Domino servers. The data was averaged across two IBM Lotus Domino servers, each with exactly the same number of IBM Lotus Domino and BlackBerry user accounts enabled for all benchmarking scenarios. See “Performance tests” on page 23 for more information about each performance test.

  • Page 28: Processor Use

    IBM Lotus Domino with respect to processor time. For all other BlackBerry services, the processor time remained below 7%. The largest increase was noted with the BlackBerry Synchronization Service enabled, which resulted in a 3.2-time increase from the baseline value. See “Appendix: Calculations and data”...

  • Page 29: Memory Use

    69-MB increase in memory from email and calendar activity with 2000 user accounts enabled. The BlackBerry Synchronization Service appears to have a small impact on memory use on the IBM Lotus Domino server; all other BlackBerry services showed little or no impact on memory use.

  • Page 30: Disk Use

    BlackBerry user accounts with specific features. From the baseline, the largest increase occurred with all BlackBerry features (that were benchmarked) enabled. Disk transfers /sec grew from 110.18 to 147.21. This is far below the maximum capacity that the disk subsystem can handle. Because IBM Lotus Domino performs its own memory management, outside of the operating system, there are instances where paging activity was triggered and contributed to disk transfers.
  • Page 31 The impact observed by RIM is specific to the workload applied and might vary from site to site. The relative impact observed occurs only on messaging traffic specific to what the BlackBerry Enterprise Server redirects. The impact is not a multiplier that can be applied to existing disk traffic because the impact might also include disk activity from other applications, backups occurring on the disk subsystem, or other IBM Lotus Domino traffic not specific to BlackBerry redirection.

  • Page 32: Network Use

    Network use RIM collected the network bytes /sec counter on the IBM Lotus Domino servers to understand the impact of enabling BlackBerry user accounts with specific features on the network infrastructure from an IBM Lotus Domino server perspective. Out of all the data collected, RIM observed that the largest increase in network use occurred when all of the features that were benchmarked were enabled.

  • Page 33: Performance Impact Considerations

    Before enabling BlackBerry user accounts, complete a baseline test of the system. To assess the impact of the BlackBerry user accounts on the IBM Lotus Domino server infrastructure, compare the baseline performance of the IBM Lotus Domino server to the performance of the IBM Lotus Domino server as you enable BlackBerry user accounts.
  • Page 34 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking...

  • Page 35: Microsoft Sql Server 2000 Performance Test Results

    Performance impact considerations Overview of the test results This section provides information on the observed impact of the BlackBerry Enterprise Server on Microsoft SQL Server 2000. The performance tests measured the average processor time, average memory committed in bytes, average network bytes /sec, average disk transfers /sec, average SQL transactions /sec, and average user connection count.

  • Page 36: Processor Use

    1.26% when all 2000 BlackBerry user accounts were enabled. Out of all the features, RIM observed the largest increase in processor use when the BlackBerry Synchronization Service along with the core BlackBerry features (email, calendar, and sent item redirection) were enabled.

  • Page 37: Transactions /Sec

    7: Microsoft SQL Server 2000 performance test results Transactions /sec The transaction /sec counter indicates the load that is placed on the Microsoft SQL Server by the BlackBerry Enterprise Server. During the performance testing, the maximum transaction rate was 17.98 /sec with all benchmarked features enabled for 2000 user accounts.

  • Page 38: User Connection Count

    Microsoft SQL Server. The BlackBerry Enterprise Server is designed to minimize the number of connections to the BlackBerry Configuration Database when MSDE is used instead of Microsoft SQL Server. The data from this test is specific to a remote Microsoft SQL 2000 Server.

  • Page 39: Performance Impact Considerations

    If auto refresh is enabled, the BlackBerry Manager queries the BlackBerry Configuration Database at a rate that might result in a larger impact on the BlackBerry Configuration Database, depending on the rate set and the number of BlackBerry Managers that are open.
  • Page 40 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking...

  • Page 41: Blackberry Enterprise Server Performance Test Results

    The following table shows the impact of BlackBerry user accounts on processor time and memory use when features are enabled. Test 1 was a baseline test (no BlackBerry user accounts) and has therefore been excluded. The counters in this table were collected using System Monitor on a Windows Server 2003.

  • Page 42: Processor Use

    41%. To determine the impact of each feature on the BlackBerry Enterprise Server, the IBM Lotus Domino server, and the Microsoft SQL Server, each feature was run individually. The following graphic illustrates that the processor time percentage was well within the recommended threshold of 75% for this counter.

  • Page 43: Memory Use

    BlackBerry Enterprise Server uses about 1.64 GB of memory for 2000 user accounts. Because you can choose not to install the BlackBerry Collaboration Service and the BlackBerry MDS Services, and because these components were not part of the benchmarking for this document, RIM did not install them. If these components are installed and running, even if they are not being used, a footprint is associated with them.

  • Page 44: Messages Received Per Minute

    BlackBerry Enterprise Server — average messages queued for delivery Messages received per minute In their testing, RIM monitored the number of messages that the BlackBerry Enterprise Server received during each test run. Because the agent driving the load has some randomness associated with it (for example the number of recipients selected for an email message is between 3 and 5), the results varied slightly from test to test;...

  • Page 45: Network Use

    Perform the following actions when administering the BlackBerry Enterprise Server hardware: • Verify that the BlackBerry Enterprise Server hardware can handle increases in processor time use. Make sure that the BlackBerry Enterprise Server is not running at more than 75% processor time on average, which is the maximum threshold. •...
  • Page 46 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking • Verify that enough network bandwidth is available to handle the traffic that is generated by the BlackBerry Enterprise Server. Based on the performance testing, a minimum of 9 Mbps of network bandwidth is required if all BlackBerry Enterprise Server features are enabled for 2000 user accounts (not including the BlackBerry Collaboration Service and the BlackBerry MDS Services).

  • Page 47: Conclusions

    • If you implement the BlackBerry Enterprise Solution, verify that the IBM Lotus Domino server has sufficient processor capacity and disk I/O bandwidth to handle the expected load imposed by the volume of BlackBerry user accounts under a MMB2 workload.
  • Page 48 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking...

  • Page 49: Appendix: Mmb And Mmb2 Comparison

    Appendix: MMB and MMB2 comparison Overview Overview RIM measured the BlackBerry Enterprise Server performance using MMB2, a standard developed by Compaq Computer Corporation (now Hewlett-Packard Development Company) and Microsoft. The MMB2 standard was adapted from MAPI Messaging Benchmark (MMB). Security...
  • Page 50 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking Send messages (* messaging files created by the MMB2 workload) Properties MMB2 * file name: OupsXLobj.msg * file name:McPP1Matt.msg — * file name: McPP100katt.msg — * file name: McWD2Matt.msg — recipients for each message...
  • Page 51 Appendix: MMB and MMB2 comparison Request meetings Properties MMB2 meeting length (in hours) average meeting length (in hours) maximum attendees minimum attendees average attendees maximum percentage of meeting requests with a distribution list Make appointment Properties MMB2 number of new appointments each day appointment length (in hours) minimum appointment length (in hours) average appointment length (in hours) maximum...
  • Page 52 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking Log on/log off Properties MMB2 log on at beginning of test log off at the end of each simulated day empty deleted items folder when logging off Message traffic Properties MMB2 total received messages 66.3...

  • Page 53: Blackberry Attachment Service Traffic For Mmb2

    Seventeen percent of all messages contained attachments and each message was sent to an average of five recipients. With the current load test configuration, any message that contained an attachment was immediately requested for viewing on the BlackBerry device. During the load test scenarios, concurrent viewing of attachment requests occurred.
  • Page 54 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking...

  • Page 55: Appendix: Blackberry Mds Connection Service Traffic Rate Derivation

    With 500 users signed up for 14 alert services with each service generating an hourly update, there is a 10% chance that a user will receive an extra alert during a given hour. Fewer than two alerts occur each second. The maximum number of alerts or push requests sent to the BlackBerry MDS Connection Service is eight every second.
  • Page 56 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking...

  • Page 57: Appendix: Calculations And Data

    = 12.285 accounts) with all benchmarked features enabled = 2.28 times y =%Processor Time, Test#1:baseline = 3.75 increase from the baseline value. z = increase in %Processor Time from enabling all BlackBerry user accounts for messaging and calendar Equation: increase ⎛...
  • Page 58 100% of BlackBerry user accounts (1000 user y =%Processor Time, Test#1:baseline = 3.75 accounts) for wireless message reconciliation = 0.84 times z = increase in %Processor Time from enabling all BlackBerry user accounts increase from the baseline value. for messaging and calendar Equation: increase ⎛...
  • Page 59 =(Network Mbps, Test#17:2000 BlackBerry user accounts and BlackBerry accounts enabled for the BlackBerry Synchronization Service = Synchronization Service enabled) = 6.39 1.36 Mbps y = (Network Mbps, Test#5: 2000 BlackBerry user accounts and BlackBerry Synchronization Service turned off) = 5.03 z = increase in network use Equation:...
  • Page 60 BlackBerry Enterprise Server for IBM Lotus Domino Performance Benchmarking...
  • Page 62 ©2006 Research In Motion Limited Published in Canada.

This manual is also suitable for:

Enterprise server 4.1

Table of Contents