Skip to the main content.

Curiosity Modeller

Design Complex Systems, Create Visual Models, Collaborate on Requirements, Eradicate Bugs and Deliver Quality! 

Product Overview Solutions
Success Stories Integrations
Book a Demo Release Notes
Free Trial Brochure
Pricing  

Enterprise Test Data

Stream Complete and Compliant Test Data On-Demand, Removing Bottlenecks and Boosting Coverage!

Explore Curiosity's Solutions

Our innovative solutions help you deliver quality software earlier, and at less cost!

robot-excited copy-1              AI Accelerated Quality              Scalable AI accelerated test creation for improved quality and faster software delivery.

palette copy-1                      Test Case Design                Generate the smallest set of test cases needed to test complex systems.

database-arrow-right copy-3          Data Subsetting & Cloning      Extract the smallest data sets needed for referential integrity and coverage.

cloud-cog copy                  API Test Automation              Make complex API testing simple, using a visual approach to generate rigorous API tests.

plus-box-multiple copy-1         Synthetic Data Generation             Generate complete and compliant synthetic data on-demand for every scenario.

file-find copy-1                                     Data Allocation                  Automatically find and make data for every possible test, testing continuously and in parallel.

sitemap copy-1                Requirements Modelling          Model complex systems and requirements as complete flowcharts in-sprint.

lock copy-1                                 Data Masking                            Identify and mask sensitive information across databases and files.

database-sync copy-2                   Legacy TDM Replacement        Move to a modern test data solution with cutting-edge capabilities.

Explore Curiosity's Resources

See how we empower customer success, watch our latest webinars, read our newest eBooks and more.

video-vintage copy                                      Webinars                                Register for upcoming events, and watch our latest on-demand webinars.

radio copy                                   Podcasts                                  Listen to the latest episode of the Why Didn't You Test That? Podcast and more.

notebook copy                                           eBooks                                Download our latest research papers and solutions briefs.

calendar copy                                       Events                                          Join the Curiosity team in person or virtually at our upcoming events and conferences.

book-open-page-variant copy                                          Blog                                        Discover software quality trends and thought leadership brought to you by the Curiosity team.

face-agent copy                               Help & Support                            Find a solution, request expert support and contact Curiosity. 

bookmark-check copy                            Success Stories                            Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.

file-document-multiple (1) copy                                 Documentation                            Get started with the Curiosity Platform, discover our learning portal and find solutions. 

connection copy                                  Integrations                              Explore Modeller's wide range of connections and integrations.

Better Software, Faster Delivery!

Curiosity are your partners for designing and building complex systems in short sprints!

account-supervisor copy                            Meet Our Team                          Meet our team of world leading experts in software quality and test data.

calendar-month copy                                         Our History                                Explore Curiosity's long history of creating market-defining solutions and success.

check-decagram copy                                       Our Mission                                Discover how we aim to revolutionize the quality and speed of software delivery.

handshake copy                            Our Partners                            Learn about our partners and how we can help you solve your software delivery challenges.

account-tie-woman copy                                        Careers                                    Join our growing team of industry veterans, experts, innovators and specialists. 

typewriter copy                             Press Releases                          Read the latest Curiosity news and company updates.

bookmark-check copy                            Success Stories                          Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.

book-open-page-variant copy                                                  Blog                                                Discover software quality trends and thought leadership brought to you by the Curiosity team.

phone-classic copy                                      Contact Us                                           Get in touch with a Curiosity expert or leave us a message.

3 min read

4 Reasons for Data Migration Failures

4 Reasons for Data Migration Failures

Part two in this series identified some key risk factors associated with a data migration, which underpin the shocking migration failure rates identified in part one. Let’s now consider common reasons why these risks factor are not successfully mitigated. In other words, let’s discuss four reasons for data migration project failures.

Download this entire article series in Curiosity's latest eBook, How to avoid costly migration failures.

Download the eBook

1.      You don’t understand legacy system data.

The system being migrated is, by definition, legacy. If it’s a mainframe system, it might be decades old and poorly documented. The team responsible for building the original system might further have left the organization, carrying knowledge regarding the system out the door with them.

This lack of system understanding significantly hinders the developers, BAs, and testers responsible for ensuring a smooth migration. Migrating unexpected or “bad” data from a legacy system risks outages and bugs. Lacking sufficient knowledge of the system, delivery teams cannot mitigate the risks posed by this data, as they might not even know it exists. BAs, for instance, cannot design rules for efficient or bug-free migrations, and nor can developers and testers deliver one.

2.     You don’t understand the new system functionality – and the requirements don’t help

To develop a new system ahead of a data migration, developers further require clear and complete understanding of all the desired functionality. They must know how the system should process the myriad of data that will be migrated to the new system, as well as the transforms needed to get it there.

Yet, testers and developers are typically equipped with incomplete or ambiguous requirements. These are usually text-heavy and poorly suited to the complex system logic. They furthermore rarely depict the system data or its structure clearly and comprehensively:

 

Inadequate requirements for data migrations

Text-heavy requirements are poorly matched to the logic of complex data structures.

These suboptimal requirements risk introducing functional bugs, missing functionality, and costly rework. If teams don’t know exactly how a new system should process a piece of data, how can they develop the new system pre-migration?

3.      You don’t have varied data to test the new system

However early or late you start testing your migration, your teams require comprehensive test data. This data must be capable of testing all the new system requirements against the full range of data that the new system will process. It must therefore include unexpected results, negative scenarios, and new functionality.

Yet, organisations often attempt to test a migration using a slice of production data. This unwieldy data typically lacks unexpected results, outliers, and negative scenarios. It is instead highly repetitive, reflecting the “happy path” scenarios exercised by most production users:

Production test data challenges for data migration

Production data typically contains just a fraction of the data needed for rigorous migration testing.

The historical data further lacks data for testing new functionality. For example, if a new Business Intelligence dashboard allows users to filter by an additional dimension, how can testers validate this functionality? Testing with data that lacks this dimension, QA might not even guarantee that the new data will appear in the new system.

There’s then the costly compliance risks associated with testing using production data, particularly in it’s raw form. These compliance risks were discussed in the previous article.

Overall, copying production data into a new system does not constitute rigorous testing, and nor does it offer the tools for a successful migration:

  • It does not tell you how the old system functioned
  • It does not tell you how the new system should function
  • It does not provide the scenarios needed for rigorous testing
  • It does not ensure compliance with data privacy regulations

4.      You tested too late

This is a common mistake, which was discussed in the previous article. To recap: Waiting to develop a new system before copying over test data risks finding bugs shortly before the “go live date”. This then requires rework for which time had not been forecast during migration planning.

Checklist for a successful migration project

These four common reasons for migration project failure should be addressed during the pre-planning phases of a migration. When embarking on a migration, ask yourself:

  1. Do you understand the legacy system’s data?
  2. Do you understand the new system in detail? And is that knowledge stored in requirements for future?
  3. Do you have compliant data for testing every transform and requirement?
  4. Are you testing early enough to give yourself time to fix and pivot?

Fortunately, a unified solution can fulfil each of these criteria. This integrated approach ensures that your teams have the upfront requirements, understanding and data needed for a successful migration. The next article in this series will set out this unified solution.

Download every article in this series as Curiosity's latest eBook, How to avoid costly migration failures.

Download the eBook

We Need to Talk About Test Data “Strategy”

We Need to Talk About Test Data “Strategy”

For many organisations, test data “best practices” start and end with compliance. This reflects a tendency to focus on the problem immediately in...

Read More
Curiosity and Windocks announce Containerised Test Data Automation

Curiosity and Windocks announce Containerised Test Data Automation

Curiosity Software Ireland, creators of Test Data Automation, and Windocks, on demand database specialists, today announced a joint solution for...

Read More
Time to migrate from your legacy test data (TDM) tools? Here’s how.

Time to migrate from your legacy test data (TDM) tools? Here’s how.

If you’re reading this, you’re probably already painfully familiar with the complaints that Curiosity hear from organisations seeking alternatives to...

Read More
Solutions for a successful data migration

Solutions for a successful data migration

The previous article in this series set out how a successful data migration hinges on a range of criteria:

Read More
Test Data is make or break for parallel testing and development

Test Data is make or break for parallel testing and development

Today, there is a greater-than-ever need for parallelisation in testing and development. “Agile” and iterative delivery practices hinge on teams...

Read More
Removing Quality Bottlenecks in CI/CD and DevOps

Removing Quality Bottlenecks in CI/CD and DevOps

Curiosity often discuss barriers to “in-sprint testing”, focusing on techniques for reliably releasing fast-changing systems. These solutions...

Read More
8 Criteria for a Modern Test Data Solution

8 Criteria for a Modern Test Data Solution

In 2023, (test) data availability, quality, and compliance risks remain a major headache for software development.

Read More
Turn GDPR Compliance into an Opportunity for Better, Faster Testing

Turn GDPR Compliance into an Opportunity for Better, Faster Testing

Ever-tighter data privacy legislation like the EU General Data Protection Regulation and The California Consumer Privacy Act has made test data a...

Read More
Removing Barriers to In-Sprint Testing and Development - Infographic

Removing Barriers to In-Sprint Testing and Development - Infographic

Test automation must be lightweight, re-usable and easy to apply, in order to help organisations, ease its implementation enterprise wide. Curiosity...

Read More