Key risk factors to mitigate during a data migration
Part one in this article series summarized the shockingly high failure rates for migration projects, identifying data migration as a key area of...
Design Complex Systems, Create Visual Models, Collaborate on Requirements, Eradicate Bugs and Deliver Quality!
Product Overview | Solutions |
Success Stories | Integrations |
Book a Demo | Release Notes |
Free Trial | Brochure |
Pricing |
Our innovative solutions help you deliver quality software earlier, and at less cost!
AI Accelerated Quality Scalable AI accelerated test creation for improved quality and faster software delivery.
Test Case Design Generate the smallest set of test cases needed to test complex systems.
Data Subsetting & Cloning Extract the smallest data sets needed for referential integrity and coverage.
API Test Automation Make complex API testing simple, using a visual approach to generate rigorous API tests.
Synthetic Data Generation Generate complete and compliant synthetic data on-demand for every scenario.
Data Allocation Automatically find and make data for every possible test, testing continuously and in parallel.
Requirements Modelling Model complex systems and requirements as complete flowcharts in-sprint.
Data Masking Identify and mask sensitive information across databases and files.
Legacy TDM Replacement Move to a modern test data solution with cutting-edge capabilities.
See how we empower customer success, watch our latest webinars, read our newest eBooks and more.
Events Join the Curiosity team in person or virtually at our upcoming events and conferences.
Blog Discover software quality trends and thought leadership brought to you by the Curiosity team.
Help & Support Find a solution, request expert support and contact Curiosity.
Success Stories Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.
Documentation Get started with the Curiosity Platform, discover our learning portal and find solutions.
Integrations Explore Modeller's wide range of connections and integrations.
Curiosity are your partners for designing and building complex systems in short sprints!
Meet Our Team Meet our team of world leading experts in software quality and test data.
Our History Explore Curiosity's long history of creating market-defining solutions and success.
Our Mission Discover how we aim to revolutionize the quality and speed of software delivery.
Our Partners Learn about our partners and how we can help you solve your software delivery challenges.
Careers Join our growing team of industry veterans, experts, innovators and specialists.
Press Releases Read the latest Curiosity news and company updates.
Success Stories Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.
Blog Discover software quality trends and thought leadership brought to you by the Curiosity team.
Contact Us Get in touch with a Curiosity expert or leave us a message.
3 min read
Thomas Pryce 30 August 2022 09:34:57 BST
Today, the majority of enterprises are engaged in ongoing system migrations – and most of those projects will either fail completely, overrun on time, or exceed their budget.
Too often, key failings during data migrations combine with insufficient testing and design. This leads to compliance risks and costly bugs, which are often only identified once it’s too late.
This series of articles will evaluate key causes for data migration failures, setting out a unified approach for data migration success. This first article opens by summarising the shocking rates of migration failures today. Part two will set out three key risk factors to mitigate during a successful data migration, before part three identifies four key reasons for data migration failures.
Part four will then outline a unified solution for solving data migration failings. The integrated approach will combine data analysis and archaeology, with automated test generation and requirements modelling. This provides the data, requirements and understanding needed for a successful data migration, while moving “shift left” testing far earlier in the migration project.
You can read the entirety of this article series in Curiosity’s latest eBook, How to avoid costly migration failures.
Migration projects are lengthy, costly, and risky.
They are risky because they are lengthy and costly, and because of their unacceptably high failure rate. Two outdated figures are often quoted in articles today:
These figures are still cited today because they are shocking, and because there is a lack of current research into overall migration project success. There is, however, uncited research referenced in a 2021 Forbes article, which states that 64% of data migrations overrun their forecast budget, with 54% overrunning on time [3].
Otherwise, for newer research, it seems you need to look at particular types of migration. This doesn’t make for much better reading, suggesting that the challenges of migrating systems are yet to be solved. Consider, for instance, ERP and Cloud migrations:
Far too many migration projects today fail or are challenged.
Given their length, cost, and evident risk, why are most enterprises engaged in migration projects? Because they are necessary to modernisation, and to achieving the scalability, operational efficiency and capabilities offered by new technologies.
This is why, for instance, most enterprises aspire to spend 80% of their IT hosting budget on the cloud by 2024 [7], while cloud spending currently represents approximately 30% of overall IT budgets [8].
This next article in this series will consider a key reason for migration project failures: challenges during the data migration [9]. It will identify three core risks during data migrations, which are often not mitigated successfully today. Parts three and four will then discuss criteria for data migration success, presenting a unified solution for enabling data migration success.
Read the entirety of these articles in Curiosity’s latest eBook, How to avoid costly migration failures.
References
[1] Philip Howard (Bloor Research: 2007), Data Migration Survey, Pp. 1-2. Cited in Philip Howard (Bloor Research: 2011), Data Migration Report. Retrieved from https://www.bloorresearch.com/research/data-migration-report-2011/ on August 4th 2022.
[2] Philip Howard (2011), Data Migration Report, P. 10.
[3] Steve McDowell (Forbes: 2021), “Overcoming the Challenges of Data Migration”. Retrieved from https://www.forbes.com/sites/moorinsights/2021/03/15/overcoming-the-challenges-of-data-migration/?sh=22794d8e427c on August 4th 2022.
[4] Didier Casanova, Swati Lohiya, Jerome Loufrani, Matteo Pacca, and Peter Peters (McKinsey Digital: 2019), “Agile in enterprise resource planning: A myth no more”. Retrieved from https://www.mckinsey.com/business-functions/mckinsey-digital/our-insights/agile-in-enterprise-resource-planning-a-myth-no-more on August 4th 2022.
[5] Tara Balakrishnan, Chandra Gnanasambandam, Leandro Santos, and Bhargs Srivathsan (McKinsey: 2021), “Cloud-migration opportunity: Business value grows, but missteps abound”. Retrieved from https://www.mckinsey.com/industries/technology-media-and-telecommunications/our-insights/cloud-migration-opportunity-business-value-grows-but-missteps-abound on August 4th 2022.
[6] Cloud Security Alliance (2019), Enterprise Resource Planning and Cloud Adoption, cited in Cloudreach (CIODive: 2021), “Why do cloud migrations fail?”. Retrieved from https://www.ciodive.com/spons/why-do-cloud-migrations-fail/600946/ on August 4th 2022.
[7] “Cloud-migration opportunity: Business value grows, but missteps abound”.
[8] Dave McCarthy (IDC), quoted in Paula Rooney (CIO: 2022), “CIOs contend with rising cloud costs”. Retrieved from https://www.cio.com/article/403231/cios-contend-with-rising-cloud-costs.html on August 4th 2022.
[9] See, for example, Velostrata and Dimensional Research (2017), cited in ChannelProNetwork. Retrieved from https://www.channelpronetwork.com/news/research-shows-nearly-half-all-cloud-migration-projects-over-budget-and-behind-schedule on August 4th 2022.
Part one in this article series summarized the shockingly high failure rates for migration projects, identifying data migration as a key area of...
If you’re reading this, you’re probably already painfully familiar with the complaints that Curiosity hear from organisations seeking alternatives to...
Part two in this series identified some key risk factors associated with a data migration, which underpin the shocking migration failure rates...
Today, there is a greater-than-ever need for parallelisation in testing and development. “Agile” and iterative delivery practices hinge on teams...
For many organisations, test data “best practices” start and end with compliance. This reflects a tendency to focus on the problem immediately in...
The previous article in this series set out how a successful data migration hinges on a range of criteria:
Okay, so that title doesn’t make complete sense. However, if you read to the end of this article, all will become clear. I’m first going to discuss...
In 2023, (test) data availability, quality, and compliance risks remain a major headache for software development.
I’ve been harping on about GDPR and other recent developments in compliance for years now, and it’s good to see QA organisations are now seriously...