Search

Monday 11 March 2013

Web test tools list

Introduction

In this post I'll collect the information about existing web test automation tools (both from vendors and open source). It is represented as the catalogue with basic information rather that some comparison characteristics.

NOTE
The content of this post will be appended/updated from time to time to reflect the most recent changes. Also, some information may be not very precise as it is not so widely accessible. So, any comments related to information corrections are welcome

Vendor Tools

ToolVendorDescriptionSupported BrowsersSupported SystemsPriceScripting/Programming technology
Quick Test ProHPFunctional/regression test tool from HP (formerly Mercury); keyword-driven; includes support for testing Web, Java, ERP, etc.
  • Internet Explorer
  • Firefox
  • Safari
  • Chrome
Windows>$10,000VBScript
Rational Functional TesterIBM IBM Rational Functional Tester is an automated functional testing and regression testing tool. This software provides automated testing capabilities for functional, regression, GUI, and data-driven testing. Rational Function Tester supports a range of applications, such as web-based, .Net, Java, Siebel, SAP, terminal emulator-based applications, PowerBuilder, Ajax, Adobe Flex, Dojo Toolkit, GEF, Adobe PDF documents, zSeries, iSeries, and pSeries.
  • Internet Explorer
  • Firefox
  • ???
Windows $3,020-$12,300 Java
TestCompleteSmartbear Got an aggressive testing schedule? No problem. With this automated testing tool, designed for advanced and novice testers alike, you can create, manage and run tests for any desktop, Web or rich client software. Revel in the easy-to-use interface and script-free testing combined with a powerful set of customization features.
  • Internet Explorer
  • Firefox
  • Chrome
Windows$4499
  • VBScript
  • JScript
  • DelphiScript
  • C# Script
  • C++ Script
SilkTestMicrofocus (former Borland, Segue) Functional test tool from Microfocus (formerly from Borland, formerly from Segue) for Web, Java or traditional client/server-based applications. Features include: test creation and customization, test planning and management, direct database access and validation, recovery system for unattended testing, and IDE for developing, editing, compiling, running, and debugging scripts, test plans, etc.
  • Internet Explorer
  • Firefox
  • Chrome
Windows~$9000
  • 4Test
  • Java (requires silk4j and Open Agent)
  • C# (requires silk4net and Open Agent)
SquishFroglogic Squish is the leading cross-platform/cross-technology GUI test automation tool for functional GUI regression tests. Many companies in all kinds of industries all over the world use Squish to drastically cut down the time spent on GUI testing software releases while increasing the quality of their applications.
  • Internet Explorer (6.x - 9.x)
  • Firefox (1.x - 4.x)
  • Safari (Mac OS X and iOS)
  • Chrome
  • Opera
  • Windows
  • Linux, embedded Linux and MeeGo
  • Unix
  • Mac OS X
  • Several embedded and mobile platforms
€2,300-€12,000
  • JScript
  • Python
  • Perl
  • Tcl
  • Ruby
Coded UI TestMicrosoft Test Automation Framework by Microsoft provided as the part of Visual Studio. Accessible for Premium and Ultimate editions.
  • Internet Explorer
  • Firefox
  • Chrome
Windows$3,000-$12,000 (depending on Visual Studio edition)C#
TestingAnywhereTesting Anywhere Testing Anywhere is a powerful and easy to use automated software testing tool that allows users to automate any type of testing. Powerful GUI based recording capabilities and a no-programming required user interface allows testers to quickly set up even complex test cases. A built-in editor allows users to build tests that can be easily edited to allow for changes in the test cases.
  • Explorer (6.0 & later)
  • Firefox (2.x & later)
  • Opera (9.0 & later)
  • Safari (3.0 & later)
  • Chrome (2.x & later)
Windows$2,500-$7,000Custom
Test StudioTelerik Test Studio from Telerik is a point-and-click software testing tool that helps users build in-depth automated web and desktop. Users can use smart wizards to visually highlight an element and automatically generate verifications, without the need for coding. Test maintenance is faster using web element abstraction techniques. Can test HTML5, AJAX, Silverlight and WPF apps, JavaScript calls, Telerik controls, dynamic page synchronization, client-side behaviors, UI virtualizations and XAML animations.
  • Internet Explorer
  • Firefox
  • Safari
  • Chrome
Windows$2,499Custom
SmarteScriptSmarteSoft Functional test automation tool from SmarteSoft which provides quite powerful engine for tests scripting which minimizes necessity of programming knowledge. Windows~$10,000Custom
Ranorex Automation FrameworkRanorexRanorex Studio provides an all-on-one environment for developing Ranorex test automation projects. In addition to common IDE features like a code editor, code completion and debugging. Ranorex Studio also integrates all of the Ranorex tools and the powerful Ranorex Library in one professional environment.
  • Internet Explorer 6.0 and higher
  • Firefox 3.0 and higher
  • Chrome 12 and higher
  • Safari 5.1 and higher
Windows €3,080
  • C#
  • VB.NET

Open Source tools

Tool/FrameworkDescriptionSupported BrowsersSupported SystemsScripting/Programming technology
WatiR Watir, pronounced water, is an open-source (BSD) family of Ruby libraries for automating web browsers. It allows you to write tests that are easy to read and maintain. It is simple and flexible.
  • Internet Explorer
  • Firefox
  • Chrome
  • Opera
  • Hadless (HtmlUnit)
Windows, Unix, Mac OSRuby
WatiN Inspired by Watir development of WatiN started in December 2005 to make a similar kind of Web Application Testing possible for the .Net languages. Since then WatiN has grown into an easy to use, feature rich and stable framework. WatiN is developed in C# and aims to bring you an easy way to automate your tests with Internet Explorer and FireFox using .Net.
  • Internet Explorer
  • Firefox
WindowsC#
WatiJ Watij (pronounced wattage) stands for Web Application Testing in Java. Watij is a Java API created to allow for the automation of web applications. Inspired by the simplicity of Watir and enhanced by the power of Java, Watij automates functional testing of web applications through real web browsers.
  • Internet Explorer
  • Firefox
  • Safari
Windows, Unix, Mac OSJava
Selenium-RC Selenium Remote Control (RC) is a test tool that allows you to write automated web application UI tests in any programming language against any HTTP website using any mainstream JavaScript-enabled browser. Since the Selenium 2.0 version it is merged with WebDriver and at the moment the Selenium Remote Control is officially deprecated
  • Internet Explorer
  • Firefox
  • Chrome
  • Safari
  • Opera
Windows, Unix, Mac OSJava, C#, Ruby, Python, Perl, PHP
WebDriver WebDriver is designed to provide a simpler, more concise programming interface in addition to addressing some limitations in the Selenium-RC API. Selenium-WebDriver was developed to better support dynamic web pages where elements of a page may change without the page itself being reloaded. WebDriver’s goal is to supply a well-designed object-oriented API that provides improved support for modern advanced web-app testing problems.
  • Internet Explorer
  • Firefox
  • Chrome
  • Safari
Windows, Unix, Mac OSJava, C#, Ruby, Python, Perl, PHP
WebRat Webrat lets you quickly write expressive and robust acceptance tests for a Ruby web application. Actually, it provides common abstraction layer on WebDriver and WatiR.
  • Internet Explorer
  • Firefox
  • Chrome
  • Safari
  • Opera
Windows, Unix, Mac OSRuby
Capybara Capybara helps you test web applications by simulating how a real user would interact with your app. It is agnostic about the driver running your tests and comes with Rack::Test and Selenium support built in. WebKit is supported through an external gem. The API looks similar to the WebRat however this project is quite new and have more recent updates
  • Internet Explorer
  • Firefox
  • Chrome
  • Safari
  • Opera
Windows, Unix, Mac OSRuby
HttpUnit Written in Java, HttpUnit emulates the relevant portions of browser behavior, including form submission, JavaScript, basic http authentication, cookies and automatic page redirection, and allows Java test code to examine returned pages either as text, an XML DOM, or containers of forms, tables, and links. When combined with a framework such as JUnit, it is fairly easy to write tests that very quickly verify the functioning of a web site. Own headless browser Windows, Unix, Mac OSJava
HtmlUnit HtmlUnit is a "GUI-Less browser for Java programs". It models HTML documents and provides an API that allows you to invoke pages, fill out forms, click links, etc... just like you do in your "normal" browser. It's more high-level library than HttpUnit and operates with abstractions which are close to page objects representation. Own headless browser Windows, Unix, Mac OSJava
Canoo WebTest Free Java Open Source tool for automatic functional testing of web applications. XML-based test script code is editable with user's preferred XML editor; until recording capabilities are added, scripts have to be developed manually. Can group tests into a testsuite that again can be part of a bigger testsuite. ANY ANYXML
CubicTest ubicTest is a graphical Eclipse plug-in for writing Selenium and Watir tests. It makes web tests faster and easier to write, and provides abstractions to make tests more robust and reusable. N/AN/AXML
Fitnesse The fully integrated standalone wiki and acceptance testing framework N/AN/AWiki pages + Java background

Links to useful resources

8 comments:

  1. Great post & clear explanation on Functional testing Tools

    ReplyDelete
  2. What r the best tools that cn b used to automate siebel?

    ReplyDelete
  3. Are you still maintaining this? If so, do you mind updating the froglogic Squish information? The pricing as well as some of the details are not accurate (pricing too high for example, and for scripting languages Squish supports python, javascript, perl, tcl and ruby).

    ReplyDelete
    Replies
    1. Some updated information on Squish:
      Price: Squish starts at EUR 2,400 or ~US$3,300. Licensing explained here: http://www.froglogic.com/squish/gui-testing/prices-and-licensing/index.php

      Supported scripting languages: Python, JavaScript, Perl, Tcl, Ruby

      Supported platforms available here (more than listed in table above): http://www.froglogic.com/squish/gui-testing/

      Summary: Test many different technologies, with access to each technologies API and object properties. If your application is cross-platform or cross-browser, then so are your tests! Can even test applications made up of multiple technologies.

      Eval form: http://www.froglogic.com/squish/evaluate.php

      Delete
    2. Thank you. I've made updates. However, regarding pricing, as I remember I didn't take into account some cheaper licenses like named license as it's not something you can easily use for enterprise level projects (e.g. for some tools named licenses aren't working under virtual machines). In particular it explains price for Test Complete (there're licenses cheaper than $4K)

      Anyway, thank you for the info.

      Delete
  4. This comment has been removed by a blog administrator.

    ReplyDelete
  5. Thanks for the list, Nickolay. See what you think on Testomato from http://www.testomato.com

    ReplyDelete
  6. Please include information about ZAPTEST. It's Windows-based tool, can test any application on any platform (including mobile). Suitable for cross-browser/platform test automation. Has free version. WWW.ZAPTEST.COM

    ReplyDelete