Introduction
In this post I'll collect the information about existing web test automation tools (both from vendors and open source). It is represented as the catalogue with basic information rather that some comparison characteristics.
NOTE |
The content of this post will be appended/updated from time to time to reflect the most recent changes. Also, some information may be not very precise as it is not so widely accessible. So, any comments related to information corrections are welcome |
Vendor Tools
Tool | Vendor | Description | Supported Browsers | Supported Systems | Price | Scripting/Programming technology |
---|---|---|---|---|---|---|
Quick Test Pro | HP | Functional/regression test tool from HP (formerly Mercury); keyword-driven; includes support for testing Web, Java, ERP, etc. |
|
Windows | >$10,000 | VBScript |
Rational Functional Tester | IBM | IBM Rational Functional Tester is an automated functional testing and regression testing tool. This software provides automated testing capabilities for functional, regression, GUI, and data-driven testing. Rational Function Tester supports a range of applications, such as web-based, .Net, Java, Siebel, SAP, terminal emulator-based applications, PowerBuilder, Ajax, Adobe Flex, Dojo Toolkit, GEF, Adobe PDF documents, zSeries, iSeries, and pSeries. |
|
Windows | $3,020-$12,300 | Java |
TestComplete | Smartbear | Got an aggressive testing schedule? No problem. With this automated testing tool, designed for advanced and novice testers alike, you can create, manage and run tests for any desktop, Web or rich client software. Revel in the easy-to-use interface and script-free testing combined with a powerful set of customization features. |
| Windows | $4499 |
|
SilkTest | Microfocus (former Borland, Segue) | Functional test tool from Microfocus (formerly from Borland, formerly from Segue) for Web, Java or traditional client/server-based applications. Features include: test creation and customization, test planning and management, direct database access and validation, recovery system for unattended testing, and IDE for developing, editing, compiling, running, and debugging scripts, test plans, etc. |
|
Windows | ~$9000 |
|
Squish | Froglogic | Squish is the leading cross-platform/cross-technology GUI test automation tool for functional GUI regression tests. Many companies in all kinds of industries all over the world use Squish to drastically cut down the time spent on GUI testing software releases while increasing the quality of their applications. |
|
|
€2,300-€12,000 |
|
Coded UI Test | Microsoft | Test Automation Framework by Microsoft provided as the part of Visual Studio. Accessible for Premium and Ultimate editions. |
|
Windows | $3,000-$12,000 (depending on Visual Studio edition) | C# |
TestingAnywhere | Testing Anywhere | Testing Anywhere is a powerful and easy to use automated software testing tool that allows users to automate any type of testing. Powerful GUI based recording capabilities and a no-programming required user interface allows testers to quickly set up even complex test cases. A built-in editor allows users to build tests that can be easily edited to allow for changes in the test cases. |
|
Windows | $2,500-$7,000 | Custom |
Test Studio | Telerik | Test Studio from Telerik is a point-and-click software testing tool that helps users build in-depth automated web and desktop. Users can use smart wizards to visually highlight an element and automatically generate verifications, without the need for coding. Test maintenance is faster using web element abstraction techniques. Can test HTML5, AJAX, Silverlight and WPF apps, JavaScript calls, Telerik controls, dynamic page synchronization, client-side behaviors, UI virtualizations and XAML animations. |
|
Windows | $2,499 | Custom |
SmarteScript | SmarteSoft | Functional test automation tool from SmarteSoft which provides quite powerful engine for tests scripting which minimizes necessity of programming knowledge. | Windows | ~$10,000 | Custom | |
Ranorex Automation Framework | Ranorex | Ranorex Studio provides an all-on-one environment for developing Ranorex test automation projects. In addition to common IDE features like a code editor, code completion and debugging. Ranorex Studio also integrates all of the Ranorex tools and the powerful Ranorex Library in one professional environment. |
|
Windows | €3,080 |
|
Open Source tools
Tool/Framework | Description | Supported Browsers | Supported Systems | Scripting/Programming technology |
---|---|---|---|---|
WatiR | Watir, pronounced water, is an open-source (BSD) family of Ruby libraries for automating web browsers. It allows you to write tests that are easy to read and maintain. It is simple and flexible. |
|
Windows, Unix, Mac OS | Ruby |
WatiN | Inspired by Watir development of WatiN started in December 2005 to make a similar kind of Web Application Testing possible for the .Net languages. Since then WatiN has grown into an easy to use, feature rich and stable framework. WatiN is developed in C# and aims to bring you an easy way to automate your tests with Internet Explorer and FireFox using .Net. |
|
Windows | C# |
WatiJ | Watij (pronounced wattage) stands for Web Application Testing in Java. Watij is a Java API created to allow for the automation of web applications. Inspired by the simplicity of Watir and enhanced by the power of Java, Watij automates functional testing of web applications through real web browsers. |
|
Windows, Unix, Mac OS | Java |
Selenium-RC | Selenium Remote Control (RC) is a test tool that allows you to write automated web application UI tests in any programming language against any HTTP website using any mainstream JavaScript-enabled browser. Since the Selenium 2.0 version it is merged with WebDriver and at the moment the Selenium Remote Control is officially deprecated |
|
Windows, Unix, Mac OS | Java, C#, Ruby, Python, Perl, PHP |
WebDriver | WebDriver is designed to provide a simpler, more concise programming interface in addition to addressing some limitations in the Selenium-RC API. Selenium-WebDriver was developed to better support dynamic web pages where elements of a page may change without the page itself being reloaded. WebDriver’s goal is to supply a well-designed object-oriented API that provides improved support for modern advanced web-app testing problems. |
|
Windows, Unix, Mac OS | Java, C#, Ruby, Python, Perl, PHP |
WebRat | Webrat lets you quickly write expressive and robust acceptance tests for a Ruby web application. Actually, it provides common abstraction layer on WebDriver and WatiR. |
|
Windows, Unix, Mac OS | Ruby |
Capybara | Capybara helps you test web applications by simulating how a real user would interact with your app. It is agnostic about the driver running your tests and comes with Rack::Test and Selenium support built in. WebKit is supported through an external gem. The API looks similar to the WebRat however this project is quite new and have more recent updates |
|
Windows, Unix, Mac OS | Ruby |
HttpUnit | Written in Java, HttpUnit emulates the relevant portions of browser behavior, including form submission, JavaScript, basic http authentication, cookies and automatic page redirection, and allows Java test code to examine returned pages either as text, an XML DOM, or containers of forms, tables, and links. When combined with a framework such as JUnit, it is fairly easy to write tests that very quickly verify the functioning of a web site. | Own headless browser | Windows, Unix, Mac OS | Java |
HtmlUnit | HtmlUnit is a "GUI-Less browser for Java programs". It models HTML documents and provides an API that allows you to invoke pages, fill out forms, click links, etc... just like you do in your "normal" browser. It's more high-level library than HttpUnit and operates with abstractions which are close to page objects representation. | Own headless browser | Windows, Unix, Mac OS | Java |
Canoo WebTest | Free Java Open Source tool for automatic functional testing of web applications. XML-based test script code is editable with user's preferred XML editor; until recording capabilities are added, scripts have to be developed manually. Can group tests into a testsuite that again can be part of a bigger testsuite. | ANY | ANY | XML |
CubicTest | ubicTest is a graphical Eclipse plug-in for writing Selenium and Watir tests. It makes web tests faster and easier to write, and provides abstractions to make tests more robust and reusable. | N/A | N/A | XML |
Fitnesse | The fully integrated standalone wiki and acceptance testing framework | N/A | N/A | Wiki pages + Java background |
Links to useful resources
Great post & clear explanation on Functional testing Tools
ReplyDeleteWhat r the best tools that cn b used to automate siebel?
ReplyDeleteAre you still maintaining this? If so, do you mind updating the froglogic Squish information? The pricing as well as some of the details are not accurate (pricing too high for example, and for scripting languages Squish supports python, javascript, perl, tcl and ruby).
ReplyDeleteSome updated information on Squish:
DeletePrice: Squish starts at EUR 2,400 or ~US$3,300. Licensing explained here: http://www.froglogic.com/squish/gui-testing/prices-and-licensing/index.php
Supported scripting languages: Python, JavaScript, Perl, Tcl, Ruby
Supported platforms available here (more than listed in table above): http://www.froglogic.com/squish/gui-testing/
Summary: Test many different technologies, with access to each technologies API and object properties. If your application is cross-platform or cross-browser, then so are your tests! Can even test applications made up of multiple technologies.
Eval form: http://www.froglogic.com/squish/evaluate.php
Thank you. I've made updates. However, regarding pricing, as I remember I didn't take into account some cheaper licenses like named license as it's not something you can easily use for enterprise level projects (e.g. for some tools named licenses aren't working under virtual machines). In particular it explains price for Test Complete (there're licenses cheaper than $4K)
DeleteAnyway, thank you for the info.
This comment has been removed by a blog administrator.
ReplyDeleteThanks for the list, Nickolay. See what you think on Testomato from http://www.testomato.com
ReplyDeletePlease include information about ZAPTEST. It's Windows-based tool, can test any application on any platform (including mobile). Suitable for cross-browser/platform test automation. Has free version. WWW.ZAPTEST.COM
ReplyDelete