Skip to the main content.

Curiosity Modeller

Design Complex Systems, Create Visual Models, Collaborate on Requirements, Eradicate Bugs and Deliver Quality! 

Product Overview Solutions
Success Stories Integrations
Book a Demo Release Notes
Free Trial Brochure

Enterprise Test Data

Stream Complete and Compliant Test Data On-Demand, Removing Bottlenecks and Boosting Coverage!

Explore Curiosity's Solutions

Our innovative solutions help you deliver quality software earlier, and at less cost!

robot-excited copy-1              AI Accelerated Quality              Scalable AI accelerated test creation for improved quality and faster software delivery.

palette copy-1                      Test Case Design                Generate the smallest set of test cases needed to test complex systems.

database-arrow-right copy-3          Data Subsetting & Cloning      Extract the smallest data sets needed for referential integrity and coverage.

cloud-cog copy                  API Test Automation              Make complex API testing simple, using a visual approach to generate rigorous API tests.

plus-box-multiple copy-1         Synthetic Data Generation             Generate complete and compliant synthetic data on-demand for every scenario.

file-find copy-1                                     Data Allocation                  Automatically find and make data for every possible test, testing continuously and in parallel.

sitemap copy-1                Requirements Modelling          Model complex systems and requirements as complete flowcharts in-sprint.

lock copy-1                                 Data Masking                            Identify and mask sensitive information across databases and files.

database-sync copy-2                   Legacy TDM Replacement        Move to a modern test data solution with cutting-edge capabilities.

Explore Curiosity's Resources

See how we empower customer success, watch our latest webinars, read our newest eBooks and more.

video-vintage copy                                      Webinars                                Register for upcoming events, and watch our latest on-demand webinars.

radio copy                                   Podcasts                                  Listen to the latest episode of the Why Didn't You Test That? Podcast and more.

notebook copy                                           eBooks                                Download our latest research papers and solutions briefs.

calendar copy                                       Events                                          Join the Curiosity team in person or virtually at our upcoming events and conferences.

book-open-page-variant copy                                          Blog                                        Discover software quality trends and thought leadership brought to you by the Curiosity team.

face-agent copy                               Help & Support                            Find a solution, request expert support and contact Curiosity. 

bookmark-check copy                            Success Stories                            Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.

file-document-multiple (1) copy                                 Documentation                            Get started with the Curiosity Platform, discover our learning portal and find solutions. 

connection copy                                  Integrations                              Explore Modeller's wide range of connections and integrations.

Better Software, Faster Delivery!

Curiosity are your partners for designing and building complex systems in short sprints!

account-supervisor copy                            Meet Our Team                          Meet our team of world leading experts in software quality and test data.

calendar-month copy                                         Our History                                Explore Curiosity's long history of creating market-defining solutions and success.

check-decagram copy                                       Our Mission                                Discover how we aim to revolutionize the quality and speed of software delivery.

handshake copy                            Our Partners                            Learn about our partners and how we can help you solve your software delivery challenges.

account-tie-woman copy                                        Careers                                    Join our growing team of industry veterans, experts, innovators and specialists. 

typewriter copy                             Press Releases                          Read the latest Curiosity news and company updates.

bookmark-check copy                            Success Stories                          Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.

book-open-page-variant copy                                                  Blog                                                Discover software quality trends and thought leadership brought to you by the Curiosity team.

phone-classic copy                                      Contact Us                                           Get in touch with a Curiosity expert or leave us a message.

4 min read

The Democratisation of (Test) Data

The Democratisation of (Test) Data

A glance at industry research from recent years shows that test data remains one of the major bottlenecks to fix in DevOps and CI/CD:

  1. The most recent Continuous Testing Report found that the average test team spends a massive 44% of their time finding, waiting for, or making test data.[i]
  2. The 2021-22 World Quality Report found that incomplete test data continues to undermine software quality, as organisations still lack sufficient data for all of their testing.[ii]
  3. Test data practices further pose costly compliance risks, as testers at 45% of organisations admit that they do not always follow security and privacy regulations for test data.[iii]

Curiosity have written extensively elsewhere on techniques for making complete and compliant data available on-the-fly to testers, developers, automation frameworks and CI/CD pipelines. This blog will highlight a principle underpinning many of these techniques, which is often missing from test data strategies today. Let’s call this missing ingredient of test data success “the democratisation of data”.

The need to democratise test data

An effective test data strategy today must make rich and compliant data available on demand to a range of different data requesters. These consumers are not only humans, and nor are they confined to the testing domain. They today encompass technologies and stakeholders from across cross-functional teams, including BAs, Product Owners, CI/CD pipelines, developers, and test automation frameworks.

The types of data these requesters need is usually aligned with the business language and logic of the system under test. A tester, for instance, might require a customer of a particular type, with a particular history. They’re not searching primarily for data with a particular schema or column names. In other words, they are concerned with a “business” view of the data, as opposed to a technical view of back-end databases and files.

This distinction between the technical and business is frequently overlooked in approaches to test data provisioning, such as those that rely on test teams casting complex SQL queries. This forces the skillsets of DBAs and back-end engineers onto testers, developers, and BAs.

A failure to separate the business and technical is frustrating, time-consuming, and haphazard. Delivery teams spend times wrangling data and battling with complex queries, and not testing and developing new functionality. Too often today, cross-functional teams today find themselves battling uphill with specialised and skill-intensive processes for finding data.

Separating the business and the technical

Curiosity are today working with organisations to fix this mismatch between the skills and goals of the teams who are looking for data, and the methods available to them for finding the data they need. This often involves building a Test Data Mart.

A Test Data Mart separates the technical and business understandings of data. It provides an abstraction layer and mapping between a user’s understanding of data, and that data’s technical implementation in databases and files. This then allows parallel data consumers to request the data they need using language, concepts and techniques that are familiar to them:

Test Data Mart-2

Using a Test Data Mart, parallel data requesters find and make the data they need on-the-fly.

A Test Data Mart can be used to create aggregated views of what data exists for testing and development, building a “shopping cart” to search for data. For example, testers and developers might fill out forms constructed in business language, requesting the data the need using drop-downs and fields. These inputs abstract away from the complex technical implementation of data, allowing parallel teams and frameworks to request data using the dimensions that matter to them:

Self-Service Test Data FormsSelf-service forms create eCommerce orders into a back-end database, using intuitive inputs and drop-down menus.

This approach can furthermore then store up submitted test data lookups, creating data catalogues and lists. The automated lookups then become reusable, for example when refreshing an environment. This fills an environment with a rich set of data, tailored to satisfy the on demand requests made by testers, developers and Business Analysts:

On the fly Find and Makes-1

A self-service catalogue of data lookups refreshes parallel environments on-the-fly and lets automation frameworks self-provision the data.

The same lookups can furthermore be exposed from a list to automation frameworks and CI/CD pipelines. For instance, a function in an automation script can ping a test data list via an API, allowing tests to self-provision data on-the-fly. This provides complete and “just in time” data to parallelised tests, enabling rapid and rigorous test automation without test data bottlenecks.

Completing your test data strategy

Creating a Test Data Mart that separates the business and technical view of data “democratises” test data, enabling cross-functional teams and frameworks to look up the data they need on demand. The same approach can further be integrated seamlessly with new or existing test data utilities, including data generation, masking, cloning and allocation.

This further “democratises” test data, as it makes the work done by test data engineers reusable by parallel data requesters. As these requesters consume test data on demand, they can parameterise and trigger pre-configured utilities on-the-fly. Data generation might then fill gaps in existing data, for example, while cloning and allocation ensure that every test receives the data it needs in parallel.

Any technique needed to create “gold copy” data can in turn become available to parallel data requesters on-the-fly. This removes the bottlenecks, quality issues and compliance risks associated with test data.

For an overview of the techniques unlocked when separating the technical and business attributes of data, check out this video from Curiosity’s Managing Director, Huw Price, on structured approaches to data “Find and Makes”:


To understand the components that make up a DevOps-ready test data strategy, download Curiosity’s free Test Data-as-a-Service Solution Brief.

Download the Solution Brief


[i] Capgemini, Sogeti (2020), The CONTINUOUS TESTING REPORT 2020. Retrieved from on 22/03/2021.

[ii] Capgemini, Sogeti (2021), The World Quality Report 2021-22. Retrieved from on 18/02/2022.

[iii] Capgemini, Sogeti (2021), The World Quality Report 2021-22. Retrieved from on 18/02/2022.

Is test data the engineering problem to solve in 2024?

Is test data the engineering problem to solve in 2024?

It’s 2024 and the risks associated with poor test data practices show no signs of abating.

Read More
We Need to Talk About Test Data “Strategy”

We Need to Talk About Test Data “Strategy”

For many organisations, test data “best practices” start and end with compliance. This reflects a tendency to focus on the problem immediately in...

Read More
5 Ways to Keep Your Test Data Compliant

5 Ways to Keep Your Test Data Compliant

As a result of the constantly evolving environment of global data protection legislation, test data management has become increasingly complex....

Read More
5 Test Data Challenges That Every CTO Should Know About

5 Test Data Challenges That Every CTO Should Know About

At Curiosity, we talk about test data extensively, because we believe test data is repeatedly neglected in testing and development discussions....

Read More
5 Solutions to Test Data Coverage Issues

5 Solutions to Test Data Coverage Issues

Today, more than 50% of organisations are using full-size copies of production data in database development and testing [1], while 54% of test teams...

Read More
Test Data Strategy Success: Technology and Methodology

Test Data Strategy Success: Technology and Methodology

Today, organisations utilise and adopt a range of technologies, both old and new, in service of enabling their “agile” delivery methodologies. Yet,...

Read More
Test Data is make or break for parallel testing and development

Test Data is make or break for parallel testing and development

Today, there is a greater-than-ever need for parallelisation in testing and development. “Agile” and iterative delivery practices hinge on teams...

Read More
Time to migrate from your legacy test data (TDM) tools? Here’s how.

Time to migrate from your legacy test data (TDM) tools? Here’s how.

If you’re reading this, you’re probably already painfully familiar with the complaints that Curiosity hear from organisations seeking alternatives to...

Read More
Removing Quality Bottlenecks in CI/CD and DevOps

Removing Quality Bottlenecks in CI/CD and DevOps

Curiosity often discuss barriers to “in-sprint testing”, focusing on techniques for reliably releasing fast-changing systems. These solutions...

Read More