{"id":17,"date":"2014-07-11T09:22:44","date_gmt":"2014-07-11T09:22:44","guid":{"rendered":"http:\/\/blog.gallop.net\/?p=17"},"modified":"2021-02-24T11:27:03","modified_gmt":"2021-02-24T05:57:03","slug":"an-amazing-open-source-performance-testing-tool-jmeter","status":"publish","type":"post","link":"https:\/\/www.cigniti.com\/blog\/an-amazing-open-source-performance-testing-tool-jmeter\/","title":{"rendered":"An Amazing Open-Source Performance Testing Tool &#8211; Jmeter"},"content":{"rendered":"<p><strong>Introduction<\/strong>:<\/p>\n<p>Why opt for expensive commercial tool licensing and maintenance, when free tools are available in the market. All you need to put in is a little bit of planning and effort.<\/p>\n<p><strong>Jmeter<\/strong> is one of the best leading performance testing tools from Apache open source community. With great community support, the tool supports continuous releases, improvement and meets the needs of the testers along with the needs of the business community.<\/p>\n<p>The Apache JMeter&#x2122; is 100% pure Java application designed to load test functional behavior and measure performance. Originally designed for testing Web Applications, the tool has expanded to other test functions. Since the application is written in Java, it can be run on any machine, Windows, Linux or Mac.<\/p>\n<h6>Features:<\/h6>\n<p>Apache Jmeter is used to test the performance on static as well as dynamic resources (Files, Web dynamic languages &#8211; PHP, Java, ASP.NET, Java Objects, Data Bases and Queries, FTP Servers and more). It is also used to simulate a heavy load on a server, group of servers, network or object to test its strength or to analyze overall performance under different load types. You can also use it to make a graphical analysis of performance or to test your server\/script\/object behavior under heavy concurrent load.<br \/>\n\u00bb <strong>Ability to load and performance test across many different server\/protocol types:<\/strong><\/p>\n<ul>\n<li>Web : HTTP, HTTPS,CITRIX<\/li>\n<li>Web Services: XML\/SOAP, REST.<\/li>\n<li>FTP<\/li>\n<li>Database via JDBC<\/li>\n<li>LDAP<\/li>\n<li>Message-oriented middleware (MOM) via JMS<\/li>\n<li>Mail &#8211; SMTP(S), POP3(S) and IMAP(S)<\/li>\n<li>MongoDB (NoSQL)<\/li>\n<li>Native commands or shell scripts<\/li>\n<li>TCP<\/li>\n<\/ul>\n<p><strong>The tool\u2019s benefits include: <\/strong><br \/>\n\u00bb Complete portability and 100% Java purity.<br \/>\n\u00bb Full multithreading framework which enables concurrent sampling by many threads and simultaneous sampling of different functions by separate thread groups.<br \/>\n\u00bb A GUI design that allows faster Test Plan building and debugging.<br \/>\n\u00bb Caching and offline analysis\/replaying of test results.<br \/>\n\u00bb Highly Extensible core. The core in itself offers immense value with<\/p>\n<ul>\n<li>Pluggable Samplers which allow unlimited testing capabilities.<\/li>\n<li>Several load statistics may be choosen with pluggable timers.<\/li>\n<li>Data analysis and visualization plugins which allow great extensibility as well as personalization.<\/li>\n<li>Functions can be used to provide dynamic input to a test or provide data manipulation.<\/li>\n<li>Scriptable Samplers (BeanShell, BSF-compatible languages and JSR223-compatible languages)<\/li>\n<\/ul>\n<h6>Typical Jmeter Test Plan:<\/h6>\n<p><img decoding=\"async\" src=\"https:\/\/cigniti.com\/blog\/wp-content\/uploads\/2014\/06\/jmeter-1.png\" alt=\"\"><\/p>\n<p>From the above diagram, it is clear that Listeners and Config elements can be configured at any level, thus defining the scope for them. If the listeners are defined at the Sampler level, they work only for that sampler. If they are defined at the thread group level, they can work with all the samplers under the thread group. If they are defined at the Test Plan level, they are applicable to all the thread groups and all the samplers under the thread groups.<br \/>\nHowever, this works a little different for the Config elements. Each of the config elements have their own scope which would be explained in detail at the Config Elements section.<\/p>\n<p><strong>Test Plan<\/strong><br \/>\nA test plan contains the overall settings of the performance test. A test plan can have multiple Config elements, listeners and Thread Groups. The test plan can control the execution (parallel or sequential) of thread groups and can also be used to save the responses.<\/p>\n<p><strong>Thread Group<\/strong><br \/>\nA thread group is where the number of threads (users), ramp-up rate and the start times of the thread group are defined. All the items under a thread group are executed by multiple threads\/users. A thread group can have multiple samplers, config elements, controllers etc.<\/p>\n<p><strong>Samplers<\/strong><br \/>\nThese are the actual requests made from the JMeter tool. These samplers can be a HTTP Request, Web Service request or JDBC request or can be even a java request. For performance testing the web applications using JMeter, each thread group will have several HTTP requests which will be executed by multiple threads concurrently and thus causing the load on the web application.<\/p>\n<p><strong>Config Elements<\/strong><br \/>\nConfig elements are the ones which can be configured the way the samplers \/thread groups \/ test plan are executed. The most commonly used HTTP config elements are HTTP Cookie Manager, HTTP Cache manager, HTTP Auth Manager. Similarly to run a JDBC sampler, the JDBC config element has to be specified.<\/p>\n<p><strong>Controllers<\/strong><br \/>\nControllers are used to control the flow of a thread through the thread group. All the conditions like If, for, while etc. are the examples of Controllers.<\/p>\n<p><strong>Assertions<\/strong><br \/>\nAssertions are required to validate the response that is received when a request (a sampler is executed) is made to the application. The assertions can be text assertions, XML assertions, Xpath etc.<\/p>\n<p><strong>Post Processors<\/strong><br \/>\nOnce a response is received for a particular sampler request, Post processors are used to perform actions. The most commonly used post processor is the regular expression extractor.<\/p>\n<p><strong>Timers<\/strong><br \/>\nTimers are used to delay the execution of the thread or to make the thread wait for the specified time. The commonly used timers are constant timer, Gaussian random timer etc.<\/p>\n<p><strong>Listeners<\/strong><br \/>\nListeners are the reporting entity of JMeter which can be configured at the sampler \/ thread group \/test plan level. The most commonly used listeners are View results tree, View results summary and aggregate report.<\/p>\n<h4>Third party plugins for Jmeter<\/h4>\n<p>The JMeter tool itself has a strong position in the world of performance testing, because it offers professional level features, comparable to commercial tools, and still stays free and open source. However, out-of-the-box JMeter has some weak points, mainly a lack of reporting features and visualizations.<\/p>\n<p>JP@GC targets this weak point and offers several groups of test results visualization plugins. It is a popular third-party plugins set which extends Meter\u2019s functionality with a multiple graphs, new load delivery controllers and other functions that are missing from the original JMeter package. Basically, the JP@GC set contains two types of plugins: graph plugins and JMeter functionality extensions.<\/p>\n<h6>JC@GC functionality extensions for Jmeter:<\/h6>\n<p><strong>Ultimate Thread Group: <\/strong>\u201cUltimate&#8221; means there will be no need in further Thread Group plugins.<\/p>\n<ul>\n<li>Infinite number of schedule records<\/li>\n<li>Separate ramp-up time, shutdown time, flight time for each schedule record<\/li>\n<li>And, of course, trustworthy load preview graph<\/li>\n<\/ul>\n<ul>\n<li>infinite number of schedule records<\/li>\n<li>separate ramp-up time, shutdown time, flight time for each schedule record<\/li>\n<\/ul>\n<p><strong>Stepping Thread Group:<\/strong> JMeter has only one out-of-the-box option for threads (users) scheduling: simple ramp-up. But many users, especially the users with experience on HP LoadRunner are used to a flexible thread scheduling algorithm. Stepping Thread Group adds a thread scheduling similar to LoadRunner.<\/p>\n<ul>\n<li>preview graph showing estimated load (see example screen below)<\/li>\n<li>initial thread group delay to combine several thread group activities<\/li>\n<li>increase load by portions of threads (users) with ramp-up period<\/li>\n<li>configurable hold time after all threads started<\/li>\n<li>decrease load by portions<\/li>\n<\/ul>\n<h6>Timeline &#8211; Graphs:<\/h6>\n<p>JP@GC plugin is providing the timeline based graphs which have all names like Over Time, per Second. Timeline graphs visualize the results during the test run, and also can load non-GUI JMeter test results from JTL files. The available timeline data types to plot are: response times, server hits (transactions) per second, response codes, active JMeter thread counts.<\/p>\n<p><strong>Sample Graphs:<\/strong><br \/>\n<strong>jp@gc \u2013 Hits per Seconds:<\/strong> This graph will display the hits generated by the test plan to the server per second. Hits include child samples from transactions and embedded resources hits.<br \/>\n<img decoding=\"async\" src=\"https:\/\/cigniti.com\/blog\/wp-content\/uploads\/2014\/06\/jmeter-6.png\" alt=\"\"><\/p>\n<p><strong>jp@gc \u2013 Response Time Over Time:<\/strong> This graph will display the average response time in milliseconds for each sampler.<br \/>\n<img decoding=\"async\" src=\"https:\/\/cigniti.com\/blog\/wp-content\/uploads\/2014\/06\/jmeter-7.png\" alt=\"\"><\/p>\n<p><strong>jp@gc \u2013 Response Code per Seconds:<\/strong> This graph provides the response code per second.<br \/>\n<img decoding=\"async\" src=\"https:\/\/cigniti.com\/blog\/wp-content\/uploads\/2014\/06\/jmeter-8.png\" alt=\"\"><\/p>\n<p><strong>Composite Graph: <\/strong>is a special plugin that does not collect data itself, but uses other timelines as a source. You can aggregate different data in one graph to track correlation between test parameters and examine how response time depends on active threads count. Since PerfMon Metrics Collector has also a timeline type, it can be used as a source for Composite Graph.<br \/>\n<img decoding=\"async\" src=\"https:\/\/cigniti.com\/blog\/wp-content\/uploads\/2014\/06\/jmeter-9.png\" alt=\"\"><\/p>\n<p><strong>Target Resource Monitoring:<\/strong>PerfMon Metrics Collector is the most popular component of the jmeter-plugins set. It allows to monitor the resources usage of the target computer within JMeter. It requires a special ServerAgent process to be started at target computer and plots collected data on nice graph.<br \/>\nPerfMon plugin supports collecting an unlimited number of metrics at the same time. It can collect over 75 separate metric types in groups: CPU, Memory, Disk, Network, Swap, TCP statistics, Java JMX metrics. Per-process and system total metrics are supported. In case you need to collect a custom metric that is calculated by your program\/script, you may use the Custom metric type.<\/p>\n<h6>Refer to the following link for more details on Jmeter &amp; downloads<\/h6>\n<p><a href=\"http:\/\/jmeter.apache.org\/download_jmeter.cgi\" target=\"_blank\" rel=\"nofollow noopener\">http:\/\/jmeter.apache.org\/download_jmeter.cgi<\/a><\/p>\n<p><a href=\"https:\/\/www.cigniti.com\/webinars\/performance-testing-cloud-right-eyes-webinar-series\/\"><img decoding=\"async\" class=\"aligncenter size-full wp-image-995\" src=\"https:\/\/cigniti.com\/blog\/wp-content\/uploads\/2015\/11\/Banner_08.jpg\" alt=\"performance testing, performance testing in agile environment, agile environment, agile scenario, performance builds, gallop solutions, gallop blog, gallop\" width=\"590\" height=\"163\" srcset=\"https:\/\/www.cigniti.com\/blog\/wp-content\/uploads\/Banner_08.jpg 590w, https:\/\/www.cigniti.com\/blog\/wp-content\/uploads\/Banner_08-300x83.jpg 300w\" sizes=\"(max-width: 590px) 100vw, 590px\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Introduction: Why opt for expensive commercial tool licensing and maintenance, when free tools are available in the market. All you need to put in is a little bit of planning and effort. Jmeter is one of the best leading performance testing tools from Apache open source community. With great community support, the tool supports continuous [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":13122,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[],"ppma_author":[3736],"class_list":["post-17","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-performance-testing"],"authors":[{"term_id":3736,"user_id":2,"is_guest":0,"slug":"admin","display_name":"Cigniti Technologies","avatar_url":{"url":"https:\/\/www.cigniti.com\/blog\/wp-content\/uploads\/120X120-1.png","url2x":"https:\/\/www.cigniti.com\/blog\/wp-content\/uploads\/120X120-1.png"},"user_url":"http:\/\/www.cigniti.com\/","last_name":"Technologies","first_name":"Cigniti","job_title":"","description":"Cigniti is the world\u2019s leading AI &amp; IP-led Digital Assurance and Digital Engineering services company with offices in India, the USA, Canada, the UK, the UAE, Australia, South Africa, the Czech Republic, and Singapore. We help companies accelerate their digital transformation journey across various stages of digital adoption and help them achieve market leadership."}],"_links":{"self":[{"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/posts\/17"}],"collection":[{"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/comments?post=17"}],"version-history":[{"count":0,"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/posts\/17\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/media\/13122"}],"wp:attachment":[{"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/media?parent=17"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/categories?post=17"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/tags?post=17"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.cigniti.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=17"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}