SunGard Test Results

list-table:: Summary of Login Scenario Test Results:header-rows: 1

• - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - Login Test - v1.4 - 50 - 400,000 - 8.95 sec - 8.99 sec - 11.24 sec
• - Login Test - v1.4 - 100 - 400,000 - 12.88 sec - 12.55 sec - 19.62 sec
• - Login Test - trunk (revision xxx) - 10 - 400,000 - 4.71 sec - 4.84 sec - 5.10 sec
• - Login Test - trunk (revision xxx) - 50 - 400,000 - - -
• - Login Test - trunk (revision xxx) - 100 - 400,000 - 20.75 sec - 20.16 sec - 28.35 sec

Notes/Bugs - The 90% time for trunk login is reasonably close to the average time when test run with 10 concurrent users. Logged minor issue - MIFOS-2816 to look at getting average to 1-2 second range for 10 concurrent users. (26-Mar-2010)
list-table:: Summary of Loan Account Search Scenario Test Results:header-rows: 1

• - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - Loan Search Test - v1.4 - 50 - 400,000 - 0.99 sec - 0.67 sec - 2.06 sec
• - Loan Search Test - v1.4 - 100 - 400,000 - 2.05 sec - 0.64 sec - 6.57 sec
• - Loan Search Test - trunk (revision xxx) - 10 - 400,000 - 0.38 sec - 0.15 sec - 1.67 sec
• - Loan Search Test - trunk (revision xxx) - 50 - 400,000 - 2.15 sec - 1.09 sec - 5.40 sec
• - Loan Search Test - trunk (revision xxx) - 100 - 400,000 - 2.22 sec - 0.67 sec - 8.24 sec

Notes/Bugs - Loan Account search appears responsive with 300k clients. (26-Mar-2010)
list-table:: Summary of Customer Search Scenario Test Results:header-rows: 1

• - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - Customer Search Test - v1.4 - 50 - 400,000 - 8.89 sec - 10.56 sec - 25.86 sec
• - Customer Search Test - v1.4 - 100 - 400,000 - - -
• - Customer Search Test - trunk (revision xxx) - 10 - 400,000 - 0.4 sec - 0.5 sec - 0.86 sec
• - Customer Search Test - trunk (revision xxx) - 50 - 400,000 - 14.08 sec - 14.09 sec - 30.37 sec
• - Customer Search Test - trunk (revision xxx) - 100 - 400,000 - - -

Notes/Bugs - The average and 90% times double between 10,50 and 100 users for Customer Search. Logged issue - MIFOS-2763. (26-Mar-2010)
list-table:: Summary of Collection Sheet Submit Scenario Test Results:header-rows: 1

• - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - CSE Submit Test - v1.4 - 50 - 400,000 - 20.29 sec - 9.86 sec - 70.87 sec
• - CSE Submit Test - v1.4 - 100 - 400,000 - - -
• - CSE Submit Test - trunk (revision xxx) - 10 - 400,000 - 13.57 sec - 13.68 sec - 15.83 sec
• - CSE Submit Test - trunk (revision xxx) - 50 - 400,000 - 26.01 sec - 20.27 sec - 53.29 sec
• - CSE Submit Test - trunk (revision xxx) - 100 - 400,000 - - -

Notes/Bugs - Submit is slower on trunk revision, generally slow with 10 concurrent users. Logged issue MIFOS-2815. (26-Mar-2010)
list-table:: Summary of Client Creation Scenario Test Results:header-rows: 1

• - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - Client Creation Test - v1.4 - 25 - 400,000 - 51.50 sec - 52.59 sec - 53.80 sec
• - Client Creation Test - v1.4 - 50 - 400,000 - - -
• - Client Creation Test - trunk (revision xxx) - 10 - 400,000 - 3.72 sec - 3.72 sec - 3.73 sec
• - Client Creation Test - trunk (revision xxx) - 25 - 400,000 - - -
• - Client Creation Test - trunk (revision xxx) - 50 - 400,000 - - -

Notes/Bugs -
list-table:: Summary of Loan Creation Scenario Test Results:header-rows: 1

• - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - LoanCreation Test - v1.4 - 50 - 400,000 - - -
• - Loan Creation Test - v1.4 - 100 - 400,000 - - -
• - Loan Creation Test - trunk (revision xxx) - 10 - 400,000 - 1.85 sec - 0.45 sec - 4.76 sec
• - Loan Creation Test - trunk (revision xxx) - 50 - 400,000 - 9.65 sec - 2.78 sec - 21.96 sec
• - Loan Creation Test - trunk (revision xxx) - 100 - 400,000 - - -

Notes/Bugs -

SUNGARD -Test Results on EC2 Server

list-table:: Summary of Login Scenario Test Results:header-rows: 1

• - Date - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - 15 April 2010 - Login Test - v1.3 - 10 - 350,000 - 1.47 sec - 1.46 sec - 1.72 sec
• - 20 April 2010 - Login Test - v1.4 - 10 - 350,000 - 1.59 sec - 1.54 sec - 1.82 sec
• - 22 April 2010 - Login Test - trunk (revision-17174) - 10 - 350,000 - 1.18 sec - 1.22 sec - 1.41 sec
• - 23 April 2010 - Login Test - trunk (revision-17174) - 10 - 750,000 - 2.15 sec - 2.15 sec - 2.35 sec
• - 27 April 2010 - Login Test - trunk (revision-17174) - 10 - 1,000,000 - 2.79 sec - 2.84 sec - 2.96 sec
• - 4 May 2010 - Login Test - V1.5 - 10 - 750,000 - 2.15 sec - 2.18 sec - 2.31 sec
• - 14 May 2010 - Login Test - V1.5 - 10 - 1,000,000 - 2.87 sec - 2.81 sec - 3.21 sec

Notes/Bugs -
list-table:: Summary of Loan Account Search Scenario Test Results:header-rows: 1

• - Date - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - 15 April 2010 - Loan Search Test - v1.3 - 10 - 350,000 - 0.13 sec - 0.11 sec - 0.17 sec
• - 20 April 2010 - Loan Search Test - v1.4 - 10 - 350,000 - 0.13 sec - 0.12 sec - 0.16 sec
• - 22 April 2010 - Loan Search Test - trunk (revision-17174) - 10 - 350,000 - 0.14 sec - 0.12 sec - 0.20 sec
• - 23 April 2010 - Loan Search Test - trunk (revision-17174) - 10 - 750,000 - 0.16 sec - 0.12 sec - 0.18 sec
• - 27 April 2010 - Loan Search Test - trunk (revision-17174) - 10 - 1,000,000 - 0.13 sec - 0.12 sec - 0.19 sec
• - 4 May 2010 - Loan Search Test - V1.5 - 10 - 750,000 - 0.13 sec - 0.11 sec - 0.17 sec
• - 14 May 2010 - Loan Search Test - V1.5 - 10 - 1,000,000 - 0.31 sec - 0.13 sec - 0.94 sec

Notes/Bugs -
list-table:: Summary of Customer Search Scenario Test Results:header-rows: 1

• - Date - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - 15 April 2010 - Customer Search Test - v1.3 - 10 - 350,000 - 17.11 sec - 18.23 sec - 21.46 sec
• - 20 April 2010 - Customer Search Test - v1.4 - 10 - 350,000 - 20.78 sec - 22.02 sec - 28.47 sec
• - 22 April 2010 - Customer Search Test - trunk (revision-17174) - 10 - 350,000 - 13.48 sec - 14.58 sec - 19.83
• - 23 April 2010 - Customer Search Test - trunk (revision-17174) - 10 - 750,000 - 43.74 sec - 40.50 sec - 66.88 sec
• - 27 April 2010 - Customer Search Test - trunk (revision-17174) - 10 - 1,000,000 - 58.17 sec - 60.14 sec - 65.52 sec
• - 4 May 2010 - Customer Search Test - V1.5 - 10 - 750,000 - 44.51 sec - 47.57 sec - 51.35 sec
• - 14 May 2010 - Customer Search Test - V1.5 - 10 - 1,000,000 - 56.57 sec - 57.92 sec - 63.36 sec

Notes/Bugs -
list-table:: Summary of Client Creation Scenario Test Results:header-rows: 1

• - Date - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - 15 April 2010 - Client Creation Test - v1.3 - 10 - 350,000 - 2.72 sec - 2.34 sec - 5.67 sec
• - 20 April 2010 - Client Creation Test - v1.4 - 10 - 350,000 - 0.78 sec - 0.98 sec - 2.13 sec
• - 22 April 2010 - Client Creation Test - trunk (revision-17174) - 10 - 350,000 - 1.53 sec - 1.46 sec - 3.43 sec
• - 23 April 2010 - Client Creation Test - trunk (revision-17174) - 10 - 750,000 - 1.61 sec - 1.77 sec - 1.81 sec
• - 27 April 2010 - Client Creation Test - trunk (revision-17174) - 10 - 1,000,000 - 1.65 sec - 0.29 sec - 4.77 sec
• - 4 May 2010 - Client Creation Test - V1.5 - 10 - 750,000 - 1.10 sec - 1.04 sec - 2.27 sec
• - 14 May 2010 - Client Creation Test - V1.5 - 10 - 1,000,000 - 1.71 sec - 1.76 sec - 1.81 sec

Notes/Bugs -
list-table:: Summary of Loan Account Creation Scenario Test Results:header-rows: 1

• - Date - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - 15 April 2010 - Loan Creation Test - v1.3 - 10 - 350,000 - 2.23 sec - 1.99 sec - 4.57 sec
• - 20 April 2010 - Loan Creation Test - v1.4 - 10 - 350,000 - 0.40 sec - 0.34 sec - 0.70 sec
• - 22 April 2010 - Loan Creation Test - trunk (revision-17174) - 10 - 350,000 - 1.96 sec - 1.15 sec - 5.34 sec
• - 23 April 2010 - Loan Creation Test - trunk (revision-17174) - 10 - 750,000 - 1.40 sec - 0.67 sec - 2.58 sec
• - 27 April 2010 - Loan Creation Test - trunk (revision-17174) - 10 - 1,000,000 - 1.21 sec - 0.55 sec - 2.17 sec
• - 4 May 2010 - Loan Creation Test - V1.5 - 10 - 750,000 - 0.47 sec - 0.36 sec - 1.37 sec
• - 14 May 2010 - Loan Creation Test - V1.5 - 10 - 1,000,000 - 2.74 sec - 1.97 sec - 5.39 sec

Notes/Bugs -
list-table:: Summary of Collection Sheet Entry Scenario Test Results:header-rows: 1

• - Date - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - 17 April 2010 - CSE Test - v1.3 - 10 - 350,000 - 14.37 sec - 15.14 sec - 15.82 sec
• - 21 April 2010 - CSE Test - v1.4 - 10 - 350,000 - 11.28 sec - 11.24 sec - 12.59 sec
• - 26 April 2010 - CSE Test - trunk (revision-17174) - 10 - 350,000 - 3.26 sec - 3.13 sec - 4.30 sec
• - 26 April 2010 - CSE Test - trunk (revision-17174) - 10 - 750,000 - 3.58 sec - 3.62 sec - 4.53 sec
• - 26 April 2010 - CSE Test - trunk (revision-17174) - 10 - 1,000,000(1M) - 4.41 sec - 4.40 sec - 6.36 sec
• - 03 May 2010 - CSE Test - v1.5 - 10 - 350,000 - 2.87 sec - 3.57 sec - 4.57 sec
• - 04 May 2010 - CSE Test - v1.5 - 10 - 750,000 - 3.27 sec - 3.34 sec - 4.81 sec
• - 12 May 2010 - CSE Test - v1.5 - 10 - 1,000,000 - 4.85 sec - 5.01 sec - 5.98 sec
• - 21 May 2010 - CSE Test-Cleared Trxns - trunk (revision-17174) - 10 - 1,000,000 - 4.53 sec - 4.75 sec - 6.83 sec
• - 27 May 2010 - CSE Test(300CSE's) - head-master-1342 - 1 - 1,000,000 - 1.63 sec - 1.17 sec - 1.55 sec
• - 28 May 2010 - CSE Test(300CSE's) - head-master-1342 - 5 - 1,000,000 - 3.27 sec - 3.14 sec - 4.09 sec
• - 31 May 2010 - CSE Test(300CSE's) - head-master-1342 - 10 - 1,000,000 - 5.53 sec - 5.51 sec - 6.62 sec
• - 1 June 2010 - CSE Test(300CSE's) - head-master-1342 - 30 - 1,000,000 - 6.97 sec - 7.61 sec - 9.60 sec
• - 2 June 2010 - CSE Test(300CSE's) - head-master-1342 - 1 - 1,000,000 - 1.23 sec - 1.17 sec - 1.51 sec
• - 08 June 2010 - CSE Test-Cleared Trxns(300CSE's) - head-master-1342 - 10 - 1,000,000 - 4.49 sec - 4.54 sec - 5.41 sec

Notes/Bugs -
list-table:: Summary of Collection Sheet Entry Scenario Test Results:header-rows: 1

• - Date - Test Case Description - Mifos Version - Property - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - 11 May 2010 - CSE Test - trunk (revision-17174) - false - 10 - 1,000,000 - 16.07 sec - 13.73 sec - 24.04 sec
• - 11 May 2010 - CSE Test - trunk (revision-17174) - true(default) - 10 - 1,000,000 - 5.31 sec - 3.81 sec - 7.81 sec

Notes/Bugs -
list-table:: Summary of Collection Sheet Entry Processing under load without GL generation Scenario Test Results:header-rows: 1

• - Date - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - 18 May 2010 - CSE Test - trunk (special war file) - 10 - 1,000,000 - 5.69 sec - 5.12 sec - 8.35 sec

Notes/Bugs -
list-table:: Summary of All Test Results - With Branch Manager as a logged in user:header-rows: 1

• - Date - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time - Median Time - 90% Line
• - 5 May 2010 - Login Test - trunk (revision-17174) - 10 - 1,000,000 - 1.81 sec - 1.75 sec - 2.31 sec
• - 5 May 2010 - Loan Search Test - trunk (revision-17174) - 10 - 1,000,000 - 0.11 sec - 0.10 sec - 0.18 sec
• - 5 May 2010 - Customer Search Test - trunk (revision-17174) - 10 - 1,000,000 - 0.59 sec - 0.60 sec - 1.10 sec
• - 5 May 2010 - Client Creation Test - trunk (revision-17174) - 10 - 1,000,000 - 0.75 sec - 0.53 sec - 2.36 sec
• - 5 May 2010 - Loan Creation Test - trunk (revision-17174) - 10 - 1,000,000 - 2.57 sec - 2.39 sec - 6.07 sec

Notes/Bugs -
list-table:: Summary of Birt Collection Sheet Report Test Results:header-rows: 1

• - Date - Test Case Description - Mifos Version - Number of Users - Clients in DB - Average Time
• - 03 May 2010 - Birt collection sheet report test - v1.4 - 1 - 350,000 - 10.5 sec
• - 03 May 2010 - Birt collection sheet report test - Trunk (revision-17174) - 1 - 750,000 - 11.5 sec
• - 03 May 2010 - Birt collection sheet report test - Trunk (revision-17174) - 1 - 1,000,000 - 14.2 sec
• - 06 May 2010 - Birt collection sheet report test - 1.5 - 1 - 750,000 - 10.2 sec
• - 18 May 2010 - Birt collection sheet report test - 1.5 - 1 - 1,000,000 - 14 sec

Notes/Bugs -
list-table:: Ad-hoc testing results on Trunk with 350,000 clients (1 user):header-rows: 1

• - Action - Mifos Version - Clients in DB - Average Time
• - Define additional fields(client) - Trunk(revision-17174) - 350,000 - 11.67 sec
• - View loan trxn history - Trunk(revision-17174) - 350,000 - 5.33 sec
• - View client change log - Trunk(revision-17174) - 350,000 - 1.67 sec
• - Change account status - Trunk(revision-17174) - 350,000 - 2.33 sec
• - Create multiple loan accounts - Trunk(revision-17174) - 350,000 - 7.33 sec
• - Define new client fee - Trunk(revision-17174) - 350,000 - 1 sec
• - Create new center - Trunk(revision-17174) - 350,000 - 1 sec
• - Update group information - Trunk(revision-17174) - 350,000 - 2 sec
• - Loan repayment - Trunk(revision-17174) - 350,000 - 2.33 sec
• - Create group - Trunk(revision-17174) - 350,000 - 1.33 sec
• - Create client - Trunk(revision-17174) - 350,000 - 1 sec
• - Update client status - Trunk(revision-17174) - 350,000 - 2 sec
• - Loan schedule preview - Trunk(revision-17174) - 350,000 - 2 sec
• - Update kendra information - Trunk(revision-17174) - 350,000 - 2 sec

Ad-hoc testing results on Trunk with 1,00,000 clients (1 user)