Skip to the main content.

Curiosity Modeller

Design Complex Systems, Create Visual Models, Collaborate on Requirements, Eradicate Bugs and Deliver Quality! 

Product Overview Solutions
Success Stories Integrations
Book a Demo Release Notes
Free Trial Brochure
Pricing  

Enterprise Test Data

Stream Complete and Compliant Test Data On-Demand, Removing Bottlenecks and Boosting Coverage!

Explore Curiosity's Solutions

Our innovative solutions help you deliver quality software earlier, and at less cost!

robot-excited copy-1              AI Accelerated Quality              Scalable AI accelerated test creation for improved quality and faster software delivery.

palette copy-1                      Test Case Design                Generate the smallest set of test cases needed to test complex systems.

database-arrow-right copy-3          Data Subsetting & Cloning      Extract the smallest data sets needed for referential integrity and coverage.

cloud-cog copy                  API Test Automation              Make complex API testing simple, using a visual approach to generate rigorous API tests.

plus-box-multiple copy-1         Synthetic Data Generation             Generate complete and compliant synthetic data on-demand for every scenario.

file-find copy-1                                     Data Allocation                  Automatically find and make data for every possible test, testing continuously and in parallel.

sitemap copy-1                Requirements Modelling          Model complex systems and requirements as complete flowcharts in-sprint.

lock copy-1                                 Data Masking                            Identify and mask sensitive information across databases and files.

database-sync copy-2                   Legacy TDM Replacement        Move to a modern test data solution with cutting-edge capabilities.

Explore Curiosity's Resources

See how we empower customer success, watch our latest webinars, read our newest eBooks and more.

video-vintage copy                                      Webinars                                Register for upcoming events, and watch our latest on-demand webinars.

radio copy                                   Podcasts                                  Listen to the latest episode of the Why Didn't You Test That? Podcast and more.

notebook copy                                           eBooks                                Download our latest research papers and solutions briefs.

calendar copy                                       Events                                          Join the Curiosity team in person or virtually at our upcoming events and conferences.

book-open-page-variant copy                                          Blog                                        Discover software quality trends and thought leadership brought to you by the Curiosity team.

face-agent copy                               Help & Support                            Find a solution, request expert support and contact Curiosity. 

bookmark-check copy                            Success Stories                            Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.

file-document-multiple (1) copy                                 Documentation                            Get started with the Curiosity Platform, discover our learning portal and find solutions. 

connection copy                                  Integrations                              Explore Modeller's wide range of connections and integrations.

Better Software, Faster Delivery!

Curiosity are your partners for designing and building complex systems in short sprints!

account-supervisor copy                            Meet Our Team                          Meet our team of world leading experts in software quality and test data.

calendar-month copy                                         Our History                                Explore Curiosity's long history of creating market-defining solutions and success.

check-decagram copy                                       Our Mission                                Discover how we aim to revolutionize the quality and speed of software delivery.

handshake copy                            Our Partners                            Learn about our partners and how we can help you solve your software delivery challenges.

account-tie-woman copy                                        Careers                                    Join our growing team of industry veterans, experts, innovators and specialists. 

typewriter copy                             Press Releases                          Read the latest Curiosity news and company updates.

bookmark-check copy                            Success Stories                          Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.

book-open-page-variant copy                                                  Blog                                                Discover software quality trends and thought leadership brought to you by the Curiosity team.

phone-classic copy                                      Contact Us                                           Get in touch with a Curiosity expert or leave us a message.

4 min read

The broken promise of test automation

The broken promise of test automation

Remember when test automation was being peddled as a silver bullet for testing bugbears? Of course, those vendors really meant test execution automation. Automating test execution was going to increase coverage, minimise testing time, and overall reduce the amount of money being spent on testing.  It would even butter your toast in the morning.

Well, those days are long gone. Organisations have now reckoned with implementing test automation and have grown wise to its challenges. They’ve discovered that automating one process within testing leaves many others untouched, while introducing many challenges of its own. As an industry, we’ve been left questioning.

Below, I’ll consider some of these questions, before considering how some of the ‘intelligent’ solutions being proposed today might lead us down a similar path to the ‘magic’ of test automation. I’ll then set out some questions that we need to ask ourselves before adopting our next best solution, indicating some answers. To see these answers (both technologies and techniques) in practice, watch The broken promise of test automation: why are we still hand-cranking tests?

Watch now

Some questions to ask ourselves

Having automated a % of test execution, organisations find themselves left with many questions to answer. I won’t bombard you with all the questions – and nor do I know them all. However, the following 7 should illustrate my point. Most are in fact old challenges, often exacerbated by the introduction of automated test execution:

1.    How can my team possibly create enough tests (cases or scripts) before the next release?

2.    Do I know what has been impacted by recent system changes, and what needs testing as a result?

3.    How can I check and update existing tests before the next release?

4.    Am I over-testing – have any of my tests become redundant?

5.    How can I prioritise testing to deliver meaningful results before the next release?

6.    How am I measuring testing and what’s my definition of ‘done’?

7.    Where on earth can I get all the data needed by my data-hungry tests?

 

These questions have been further compounded by the fact that systems are now more complex than ever and are changing faster than ever before. We have more logic to test in less time and teams now face an impossibly large test creation and maintenance bill. Meanwhile, we lack the tools or artefacts needed to identify what has changed across vastly complex systems. We therefore struggle to prioritise our testing before each release.

A light at the end of the tunnel?

Of course, there’s a new kid on the block. AI, ML or simply ‘automation’ with ‘intelligent’ or ‘smart’ stamped in front. These autonomous processes are going to automate whatever’s been slowing you down, magically ‘knowing’ what to test before each release and executing those tests for you. They won’t just butter your toast – they’ll put jam on it and pour your tea too.

As with all things entering the testing domain, there are two core questions that we must ask ourselves:

1.    Are we building tests that truly matter for the release?

2.    Are we optimizing our test suites in light of the changing application?

With the paradigm shift towards AI and ML, there are many further questions that must be addressed. Again, the following is just a sample:

1.    What is the model being tested? Lots of technologies identify things we could test and identify tools to run tests. For instance, they identify and maintain UI identifiers. However, how do they know what needs testing and how are we measuring testing?

2.    What data is informing these decisions? Are our toolchains integrated well enough to feed in data to prioritise and build effective tests? If using technologies that analyse patterns in existing data, how good is this data? Do we understand our systems well enough to judge this, or are we risking a high-speed “garbage in, garbage out” scenario built on black boxes?

3.    Are we delivering meaningful results to developers and the business? We can discover X thousand bugs, but can we convince developers that they are a true risk to the system? Do we know their risk, or is it simply something that didn’t quite match with our model? Are we furthermore equipping developers with the knowledge they need to fix these bugs quickly?

With the sudden proliferation of technologies in the ‘intelligent’ testing space, there is also the added uncertainty of knowing what’s really new and what’s been proven. There are old approaches that have been stamped ‘intelligent’ and then there are new approaches that have not been rigorously field tested.

There’s also the added uncertainty of knowing how to implement new approaches on top of the old. Lots of proposals for unlocking the value of AI/ML in testing focus on its promise, less on the hard thinking of how we can get there. This was frequently overlooked with test automation, and we quickly found ourselves with teams lacking the skills or time to implement it.

So, what next?

These questions are far-reaching and answering them will take some soul-searching by the testing industry. I would love to present the solution in this article, but then it would not be a solution – it would be one new proposal among many. Instead, we need to have an open conversation, mapping honestly where we are today. We must understand the most pressing problems we face, and where we need to go next.

On November 10th, I will be joining the ever insightful Daniel Howard, Senior Researcher at Bloor Research, to offer a contribution to this debate. The free webinar will consider the “broken promise of test automation”, discussing where we have arrived at with test execution automation and where we might go next. Faced with the impossibility of testing everything before each release, the webinar will return to the two questions referenced above:

1.    How can we build tests that truly matter for the release?

2.    How can we optimise our regression suites in light of changing applications?

The session will not be a pitch about how AI or ML will magically solve your problems. It will be an open and interactive discussion around techniques – new and existing – that can help us address the most pressing challenges in testing today. Our goal, through dialogue, will be to offer a plan for evolving more sustainable automation.

Together, we will map technologies equipped to make a real difference in how we test today. This will include:

1.    Automation that extends far either side of test execution, covering test creation, test data allocation, and test maintenance;

2.    Optimisation techniques for measuring and targeting testing before each release, avoiding over-testing while ensuring test coverage;

3.    Methods for capitalising on the proliferation of data that will be created as we integrate DevOps toolchains.

Some of these technologies might gravitate towards AI, ML or Expert Systems. However, all should be technologies that you can consider and start implementing tomorrow, building on current tools and techniques. Curiosity’s Director of Technology, James Walker, will further be on hand to give demos of the technologies identified in the interactive discussion. That way, you’ll know that they’re ‘real’ and not another silver bullet for testing.

The broken promise of test automation: why are we still hand-cranking tests? Now available on demand!

 
Experiments with GPT Vision for Modelling: A Journey from Screenshots to Whiteboards

6 min read

Experiments with GPT Vision for Modelling: A Journey from Screenshots to Whiteboards

The landscape of artificial intelligence is rapidly evolving. The recent announcement of GPT-4 with vision capabilities by OpenAI stands as a...

Read More
Curiosity's and EVERFI's finalist entry to the North American Software Testing Awards

2 min read

Curiosity's and EVERFI's finalist entry to the North American Software Testing Awards

The project, shortlisted for the "Best Use of Technology in a Project", reduced the time needed to create and run automated tests from weeks to...

Read More
Announcing Test Automation for Technologies Built with Apache Solr

2 min read

Announcing Test Automation for Technologies Built with Apache Solr

Curiosity Software Ireland, a specialist vendor in test data management and model-based test automation, today announced support for Apache Solr. The...

Read More
Announcing Model-Based Test Automation for Microsoft Dynamics 365

3 min read

Announcing Model-Based Test Automation for Microsoft Dynamics 365

The introduction of bi-annual major releases for Dynamics 365 bring new features and innovation more regularly to its users. However, it also...

Read More
4 Principles for scalable mobile test automation

3 min read

4 Principles for scalable mobile test automation

Welcome to Part 4/5 in our “Scalable Mobile Test Automation" series!

Read More
How Curiosity Accelerate Quality Software Delivery - Infographic

2 min read

How Curiosity Accelerate Quality Software Delivery - Infographic

Discover how Curiosity helps organisations delivery better quality software, faster. This infographic highlights key ways that Curiosity's tools,...

Read More
Curiosity, Omnext and Specialisterren Announce code-less automation

3 min read

Curiosity, Omnext and Specialisterren Announce code-less automation

Curiosity Software Ireland, specialist vendor in model-based testing, today announced its partnership with Omnext, experts in software quality...

Read More
Parasoft and Curiosity partner!

2 min read

Parasoft and Curiosity partner!

Parasoft, the global leader in automated software testing, today announced they have partnered with Curiosity Software Ireland, specialist provider...

Read More
Models in testing: Where’s their value?

3 min read

Models in testing: Where’s their value?

System models: there’s lots of different techniques today, but where is their true value for testers and developers? Here’s five ways that I’ve found...

Read More