forked from naver/ngrinder
-
Notifications
You must be signed in to change notification settings - Fork 0
/
release_note.txt
276 lines (230 loc) · 14.1 KB
/
release_note.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
3.1.3 (2013.03.29)
We're proudly releasing nGrinder 3.1.3 which fixes bugs and visibility.
This is the last version 3.1.X series, we'll work on 3.2 as a next release.
- New features and changes:
* Now test report can be viewed without login.
* A user can specify the sampling interval to make the graph not to be fluctuated.
* A user can see the per test TPS chart when the sampling interval is greater than 2.
* A user can upload and use native libs (so, dll) to reuse existing assets. This is enabled only if the security mode is disabled.
* A user can provide the any kind of custom value for monitor by regularly outputting the GC count and JVM memory usages.
* A user can upload dll or so to run test using native libs. SecurityMode should be disabled and JNA should be imported for natvie lib access.
Bug
[NGRINDER-560] - Make test report visible without login
[NGRINDER-564] - Ignore Sigar Exception while collecting network usage.
[NGRINDER-569] - Make agent status string longer
[NGRINDER-570] - Make ignore sampling option affect to the total statistics
[NGRINDER-571] - Fix DB errors occurred during running test because agent_status field is not long enough
[NGRINDER-572] - Fix inconsistency b/w total and per test statistics by timing difference
[NGRINDER-573] - Make cookie parsing impl work with secure=1 entry
[NGRINDER-575] - Make graph start from 0 on x axis
[NGRINDER-576] - Make nGrinder compilable with missing jars
[NGRINDER-578] - Make smooth sampling values for consequent calls for catching up the time
Improvement
[NGRINDER-243] - Provide an export image button for each chart
[NGRINDER-554] - Provide user defined monitoring feature
[NGRINDER-555] - Provide network usage graph in report page
[NGRINDER-556] - Save memory for monitoring graph display
[NGRINDER-557] - Provide the custom monitoring guide
[NGRINDER-559] - Improve monitor chart performance
[NGRINDER-562] - Provide per-test TPS graph in the detail report page
[NGRINDER-563] - Update jqPlot to new version.
[NGRINDER-565] - Provide the customizable agent log
[NGRINDER-566] - Make validation service accessible from plugin
[NGRINDER-574] - Introduce the sampling interval
[NGRINDER-577] - Provide the way to reserve the agent memory for native libraries.
[NGRINDER-579] - Add jna support
3.1.2 (2013.02.22)
We're proudly releasing nGrinder 3.1.2 which enhances the usability and visibility.
With some bug fix, the following improvements are for the effective operations of nGrinder.
- New features and changes:
* Enable realTime target server monitoring. Now you can see how the target server reacts during tests.
* Monitor agent network usages and be able to run the plugin to do something on the agents.
* See logs passed from agents directly in the browser.
* Provide an option which unlocks the agent memory XMX limitation (by default it was 1G). Add agent.useXmxLimit=false in ${NGRINDER_AGENT_HOME}/agent.conf to enable this
* Make the Tomcat stoppable by shutdown command.
* Use record instead of wrap by default in the script.
* Make a user be able to define new statistics.
* Provide several more useful plugin interface.
* Fix the bugs in which the some sampling points are missing in the final result.
- Details
Bug
[NGRINDER-511] - Make the agent server mode optional
[NGRINDER-512] - Provide a user defined statistic chart
[NGRINDER-516] - Fix typo errors
[NGRINDER-517] - Make the tomcat stoppable
[NGRINDER-519] - Delete pid when agent stop command run is succeeded
[NGRINDER-527] - Make the sampling count accurate and speed up the updateStatistics
[NGRINDER-528] - Make the agent monitor data is saved in DB
[NGRINDER-537] - Fix the bug which show then a test report panel in few seconds even when a user click test config panel
Improvement
[NGRINDER-509] - Make the monitor data visible in realtime
[NGRINDER-513] - Make basic_template use record not wrap
[NGRINDER-514] - Make the agent connection error more visible
[NGRINDER-515] - Delete unnecessary packages.
[NGRINDER-518] - Make logs viewable in browser
[NGRINDER-520] - Collect network usage data from agent and make it stoppable when overflow
[NGRINDER-523] - Add an option to enable agent processes to use more than 1G memory
[NGRINDER-522] - Make network usage status available in agent monitor
[NGRINDER-524] - Make the resource / lib folder feature more explicit
[NGRINDER-526] - Make an agent connect to the console with controller ip
[NGRINDER-529] - Make plugin be able to see the currently attaching agent info
[NGRINDER-530] - Split physical network check to plugin
[NGRINDER-531] - Delete copyright
[NGRINDER-532] - Fix the missing region info in the bad network situation
[NGRINDER-533] - Make chart Y value 10 at minimum
[NGRINDER-534] - Modify Layout to show the main content bigger
[NGRINDER-539] - Make console host name used in agent.conf
3.1.1 (2013.01.31)
We're proudly releasing nGrinder 3.1.1 to speed up the test and enhance the usability.
With some bug fix, the following improvements are for the effective operations of nGrinder.
- New features and changes:
* Speed up the test execution. Now all tests will take 5 seconds to execute a test.
* Embed jython 2.5.3 and json.jar in the default libraries.
* Make the agent takes less memory. now agent process need 50mb at minimum
* Shows the response byte per second and mean time to first byte in the test running panel.
* Change the default QnA site into nabble not github.
* Change Process and Thread calculation logic more stable to support more than 300 users. Please delete the previous ${NGRINDER_HOME}/process_and_thread_policy.js in advance.
- Details
Bug
[NGRINDER-482] - Add grinder.processes and grinder.threads as properties during script validation
[NGRINDER-488] - Add a error message when there are no sampling was performed.
[NGRINDER-496] - Make user not to be able to change the underlying SecurityManager
[NGRINDER-497] - Make the current pc IP resolution more stable
[NGRINDER-498] - Make security mode work
[NGRINDER-504] - Show script initialize error in log
[NGRINDER-505] - Test Comment should not be cloned
[NGRINDER-506] - Block duplicated validation
Improvement
[NGRINDER-478] - Distribute the un-predefined resources (e.g images)
[NGRINDER-479] - Speed up nGrinder performance reducing distribution cost (4~6sec)
- add json.org library as default lib as well.
[NGRINDER-480] - Make each perftest folder distributed in several folders
[NGRINDER-481] - Move the question mark in logs to just right of log title
[NGRINDER-483] - Make nabble as a QnA Site
[NGRINDER-484] - Resolve locale cookie conflict issue
[NGRINDER-485] - Add cacheManager be accessible from the script console
[NGRINDER-489] - Add control.followRedirects and to control.timeout in the basic template script
[NGRINDER-490] - Make all external links opened in the separate window
[NGRINDER-491] - Make the minimum Xms smaller to support more processes.
[NGRINDER-492] - Make sure the script is saved when user leave the script editor without save.
[NGRINDER-494] - Increase the default vuser count to 300
[NGRINDER-495] - Modify the process and thread policy to support 1000 vusers
[NGRINDER-499] - Include jython-2.5.3.jar as default lib
[NGRINDER-500] - Modify test termination condition as half of test failures for last 10 sec
[NGRINDER-502] - Add the mean time to first byte and response byte per second.
[NGRINDER-503] - Make ngrinder supports more than 2 billion test
3.1.0 (2013.01.07)
We're proudly releasing nGrinder 3.1 targeting the large organization.
With some bug fix, the following improvements are for the effective operations of nGrinder.
- New features and changes:
* Support multiple region. User now can select one of multiple network regions to choose the agents depending on the test target location.
All controllers in regions need to use a directory on network file system for controllers’ home directory.
- See http://www.cubrid.org/wiki_ngrinder/entry/controller-clustering-guide
* Share user accounts. Now a user can share his permission to other users. Then the other user can start/check test with his rights.
- http://www.cubrid.org/wiki_ngrinder/entry/user-permission
* Modified monitoring function to not to use DB to save monitor data. Now the monitor data will be saved in a data file of the test directory.
* Enable the super user role. Super user can check all user's tests and scripts without the permission for system configuration.
* Enhance the default process and thread count calculation. process count is configured in the much better way.
- See http://www.cubrid.org/wiki_ngrinder/entry/advanced-controller-configuration
* Add dynamic system configuration. You don't need to restart the server for the most of configuration changes.
- See http://www.cubrid.org/wiki_ngrinder/entry/advanced-controller-configuration
* Make agent much stable by providing the appropriate memory size (Reducing OOM)
- See http://www.cubrid.org/wiki_ngrinder/entry/agent-configuration-guide
* Add "Mean time to first byte" chart in the detailed report.
* Change the license from BDS to Apache 2.0
- Minor improvement
* Support CUBRID HA to remove the single of point failure. Make it stable as much as possible.
- See http://www.cubrid.org/wiki_ngrinder/entry/advanced-controller-configuration
* Support SHA256 password encoding depending on the configuration. Secure your account with the better password encoding.
- See http://www.cubrid.org/wiki_ngrinder/entry/advanced-controller-configuration
* Support the custom help site. Make your own site to help people.
- See http://www.cubrid.org/wiki_ngrinder/entry/advanced-controller-configuration
3.0.4 (2012.12.04)
- Hot fix for nGrinder 3.0
- Managing files using SVN Clients is now working.
Bug
[NGRINDER-385] - Managing files using SVN client is not working
3.0.3 (2012.11.XX)
- Hot fix for nGrinder 3.0
- Mostly fix the bug which happens if there are more than 1000 tests.
Bug
[NGRINDER-367] - Tests over 1000 is not supported
[NGRINDER-368] - Agent approval in the agent page 2 is not supported
[NGRINDER-369] - Test stop is delayed when there are more than 1 test to be stop
[NGRINDER-371] - Resize script select box.
Improvement
[NGRINDER-370] - Add plugin structure to make test stoppable base on the sampling.
3.0.2 (2012.11.01)
- Hot fix for nGrinder 3.0
- Mostly we made this version work on Ubuntu
Bug
[NGRINDER-332] - User specific agents show max agents value 0
[NGRINDER-333] - agent ip is always 127.0.0.1 in Ubuntu
[NGRINDER-334] - Error - Abnormally Testing (TOO_LOW_TPS)
[NGRINDER-335] - Cannot stop Test when status is "Abnormally testing"
[NGRINDER-336] - When security is on, the logs are not passed from agents
[NGRINDER-337] - Real IP should be bound to SingleConsole
[NGRINDER-338] - Not able to login when restart server while logined
[NGRINDER-344] - Mean Test time graph is wrongly calculated
[NGRINDER-346] - Each test name is not visible in accumulated statistics
[NGRINDER-351] - Log monitor does not work after first log retrieval
[NGRINDER-357] - Create the user repo even when quick test is performed.
[NGRINDER-362] - Show runcount when user use runcount in report
Improvement
[NGRINDER-352] - Add sampling listener scheme on update method in SingleConsole
[NGRINDER-354] - Make validation timeout longer (to 20 sec)
[NGRINDER-355] - Make the script console is only available where 50M perm gen memory is reserved.
[NGRINDER-356] - Make basic_template more stable
[NGRINDER-359] - Add the agent stop by admin
[NGRINDER-361] - Make stop agent more stable
[NGRINDER-363] - Hide user path on validation result
[NGRINDER-365] - Block to run test with 0 test
3.0.1 (2012.10.31)
- Hot fix for nGrinder 3.0
Bug
[NGRINDER-331] - Jar classpath is not passed to the agents
3.0 (2012.10.29)
- First Official Version
Bug
[NGRINDER-232] - Running Time is wrong
[NGRINDER-238] - If the 1st minute of Test Report and the 1st minutes of Report_in_Detail are much different
[NGRINDER-287] - Table titles are overlapped on running page
[NGRINDER-310] - Check a finished test, Running_Page was displayed for a few seconds
[NGRINDER-317] - Input testing tag as "1,2,3,4" , save, was saved as "1" "2" "3" "4"
[NGRINDER-323] - Make max runcount / max runhour checked
[NGRINDER-325] - Running_time is wrong
[NGRINDER-152] - Make security mode work.
Improvement
[NGRINDER-281] - Provide batch/shell for easy exeuction
[NGRINDER-320] - "Action" background color isn't grey when there isn't any script
[NGRINDER-314] - Provide servlet filter plugin
[NGRINDER-315] - When user provide the agent by himself, the user agent will will used only for the the given user.
3.0-b3 (2012.10.22)
- Third beta version.
Bug:
[NGRINDER-282] - Create a error showing page. For bad request which doesn't exist, redirect to index page.
[NGRINDER-283] - Provide DB upgrade feature
[NGRINDER-306] - Fixed a but to search with tag. If user selected tag to search items in perftest list page, then he can't search all items.
[NGRINDER-309] - Change script console as runtime component to speed up the test
[NGRINDER-312] - Fixed the bug about name format validation. Changed the minimal length of name to 3.
Improvement:
[NGRINDER-248] - Improved the editing in test configuration page.
[NGRINDER-288] - Improved to transfer Python module file to agents
[NGRINDER-301] - Provided agent shutdown script
[NGRINDER-302] - Delete all unused SystemDataModel DB fields.
[NGRINDER-303] - Modified to add option to create lib and resource folder when creating script.
[NGRINDER-304] - Set Max Agent Size as the min value b/w agentManager.getMaxAgentSizePerConsole(), agentManager.getAllApprovedAgents().size()
[NGRINDER-305] - Make admin be able to see user script.
3.0-b2 (2012.10.12)
- Second beta version.
change list:
NGRINDER-295 Only English character and numbers are allowed in user id.
NGRINDER-294 Fixed a bug about statistic calculation error if there are several sub-tests in script.
NGRINDER-290 Not to start monitor if loading Sigar libraries error
NGRINDER-282 Create a error showing in index page
NGRINDER-281 Provided batch/shell for easy execution
NGRINDER-299 Fixed the problem of adding duplicated tag
NGRINDER-298 Added gray ball when user stop the perftest
No Issue Fixed a bug in user creation.
3.0-b1 (2012.10.05)
- First beta version.