Skip to the main content.

Curiosity Modeller

Design Complex Systems, Create Visual Models, Collaborate on Requirements, Eradicate Bugs and Deliver Quality! 

Product Overview Solutions
Success Stories Integrations
Book a Demo Release Notes
Free Trial Brochure
Pricing  

Enterprise Test Data

Stream Complete and Compliant Test Data On-Demand, Removing Bottlenecks and Boosting Coverage!

Explore Curiosity's Solutions

Our innovative solutions help you deliver quality software earlier, and at less cost!

robot-excited copy-1              AI Accelerated Quality              Scalable AI accelerated test creation for improved quality and faster software delivery.

palette copy-1                      Test Case Design                Generate the smallest set of test cases needed to test complex systems.

database-arrow-right copy-3          Data Subsetting & Cloning      Extract the smallest data sets needed for referential integrity and coverage.

cloud-cog copy                  API Test Automation              Make complex API testing simple, using a visual approach to generate rigorous API tests.

plus-box-multiple copy-1         Synthetic Data Generation             Generate complete and compliant synthetic data on-demand for every scenario.

file-find copy-1                                     Data Allocation                  Automatically find and make data for every possible test, testing continuously and in parallel.

sitemap copy-1                Requirements Modelling          Model complex systems and requirements as complete flowcharts in-sprint.

lock copy-1                                 Data Masking                            Identify and mask sensitive information across databases and files.

database-sync copy-2                   Legacy TDM Replacement        Move to a modern test data solution with cutting-edge capabilities.

Explore Curiosity's Resources

See how we empower customer success, watch our latest webinars, read our newest eBooks and more.

video-vintage copy                                      Webinars                                Register for upcoming events, and watch our latest on-demand webinars.

radio copy                                   Podcasts                                  Listen to the latest episode of the Why Didn't You Test That? Podcast and more.

notebook copy                                           eBooks                                Download our latest research papers and solutions briefs.

calendar copy                                       Events                                          Join the Curiosity team in person or virtually at our upcoming events and conferences.

book-open-page-variant copy                                          Blog                                        Discover software quality trends and thought leadership brought to you by the Curiosity team.

face-agent copy                               Help & Support                            Find a solution, request expert support and contact Curiosity. 

bookmark-check copy                            Success Stories                            Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.

file-document-multiple (1) copy                                 Documentation                            Get started with the Curiosity Platform, discover our learning portal and find solutions. 

connection copy                                  Integrations                              Explore Modeller's wide range of connections and integrations.

Better Software, Faster Delivery!

Curiosity are your partners for designing and building complex systems in short sprints!

account-supervisor copy                            Meet Our Team                          Meet our team of world leading experts in software quality and test data.

calendar-month copy                                         Our History                                Explore Curiosity's long history of creating market-defining solutions and success.

check-decagram copy                                       Our Mission                                Discover how we aim to revolutionize the quality and speed of software delivery.

handshake copy                            Our Partners                            Learn about our partners and how we can help you solve your software delivery challenges.

account-tie-woman copy                                        Careers                                    Join our growing team of industry veterans, experts, innovators and specialists. 

typewriter copy                             Press Releases                          Read the latest Curiosity news and company updates.

bookmark-check copy                            Success Stories                          Learn how our customers found success with Curiosity's Modeller and Enterprise Test Data.

book-open-page-variant copy                                                  Blog                                                Discover software quality trends and thought leadership brought to you by the Curiosity team.

phone-classic copy                                      Contact Us                                           Get in touch with a Curiosity expert or leave us a message.

3 min read

The Illusion of Software Quality: Navigating Beyond Vanity Metrics

The Illusion of Software Quality: Navigating Beyond Vanity Metrics

In the fast-evolving world of software development, it's easy to get caught up in numbers. At Curiosity Software, a company at the forefront of software quality, we've seen first-hand how metrics can both guide and mislead enterprise organisations into providing a false sense of effective quality.

The Allure of Vanity Metrics

Vanity metrics are those impressive looking numbers that lack real substance or actionable insights. They're the metrics that make us feel good, without necessarily contributing to our software's actual quality or our business's bottom line.

In the realm of software quality, I wanted to share some examples of vanity metrics which are commonplace in the software quality landscape.

  • Number of Automated Tests: Having many automated tests doesn't mean they're effective or cover the critical aspects of the software. “We have 5000 automated tests so we must be testing well!”

  • Test Cases Executed: Simply running a large number of test cases doesn't guarantee software quality if these tests aren't targeted or meaningful.

  • Code Commit Frequency: Regular commits can indicate activity, but not necessarily progress or quality.

  • Bug Counts: High numbers of identified bugs can be misleading; they might reflect poor quality initially or an overly aggressive bug-reporting process.

  • Code Coverage: High test coverage can create a false sense of security. It's more important to have meaningful tests that cover critical and complex parts of the system.

  • Number of QA Engineers on a Project: Simply having more QA engineers doesn't guarantee better software quality. The focus should be on their expertise, collaboration, and the efficiency of the testing process.

The Real Deal: Impactful Metrics

In the domain of software quality, true value is derived from metrics that profoundly influence user experience, product reliability, and stakeholder confidence. The DevOps Research and Assessment (DORA) framework provides a comprehensive guide for measuring DevOps performance, crucial for understanding and enhancing our software development processes.

Alongside DORA's insights, we prioritize several other metrics that offer actionable insights and reflect the authentic health of our software projects:

  • Requirement Coverage: This metric evaluates how effectively our testing efforts correspond with specified requirements. More than just fulfilling requirements, it's about ensuring each requirement is met with effective tests. This thorough alignment assures that our software is not only rigorously tested, but also crafted to meet the precise needs and expectations of our customers and stakeholders.

  • Defect Escape Rate: This indicates the number of issues that make it into production. A low defect escape rate signifies a strong testing and quality assurance process, implying that we are efficiently identifying and resolving problems before they affect our users. It serves as a clear indicator of the success of our pre-release testing strategies.

  • Mean Time to Resolution (MTTR): This measures the swiftness with which we address and resolve issues after their identification. A shorter MTTR denotes agility and prompt responsiveness in our software maintenance and support, underlining our commitment to rapidly resolving user issues and enhancing overall customer satisfaction.

Incorporating DORA's key metrics, we also focus on:

  • Deployment Frequency: The rate at which we successfully release to production, reflecting our team's ability to deliver value rapidly.

  • Lead Time for Changes: The duration from commit to production, indicating the efficiency of our development pipeline.

  • Change Failure Rate: The proportion of deployments that result in production failures, a critical measure of our release stability.

  • Time to Restore Service: How quickly we can recover from a production failure, demonstrating our resilience and operational capability.

Beyond these metrics, methodologies like Model-Based Testing (MBT) significantly augment our approach to software quality. MBT, which involves generating test cases based on abstract models of software behaviour or requirements, leads to more comprehensive and efficient testing. This method aligns seamlessly with agile development practices, offering a structured yet adaptable testing approach.

Shifting Towards Meaningful Quality Metrics

The shift towards meaningful metrics is transformative. It’s tempting, as a leader, to focus on numbers that look good in reports. But the real reward comes from seeing our software make a tangible difference in users’ lives. That’s a metric that’s not easily quantified, but it's felt deeply.

As we continue to navigate the complexities of software quality, let's remind ourselves: It's not the size of the data that matters, but the depth of the insights we glean from it, and ultimately improving software quality. Let's focus on metrics that matter, those that bring real value to our users and our business.

To learn how Curiosity can help you improve your software quality, talk to a Curiosity expert today!

Schedule a Demo

How Curiosity Accelerate Quality Software Delivery - Infographic

2 min read

How Curiosity Accelerate Quality Software Delivery - Infographic

Discover how Curiosity helps organisations delivery better quality software, faster. This infographic highlights key ways that Curiosity's tools,...

Read More
Shift Left Quality With Curiosity's Modeller

5 min read

Shift Left Quality With Curiosity's Modeller

Software delivery teams across the industry have embraced agile delivery methods in order to promote collaboration between teams and deliver new...

Read More
Overcoming Challenges in Test Automation: Re-usability is the key

4 min read

Overcoming Challenges in Test Automation: Re-usability is the key

The 2020/1 edition of the World Quality Report (WQR) highlights how the expectation placed on test teams has been growing steadily. QA teams today...

Read More
Assuring Quality at Speed With Automated and Optimised Test Generation

6 min read

Assuring Quality at Speed With Automated and Optimised Test Generation

Throughout the development process, software applications undergo a variety of changes, from new functionality and code optimisation to the removal...

Read More
Experiments with GPT Vision for Modelling: A Journey from Screenshots to Whiteboards

6 min read

Experiments with GPT Vision for Modelling: A Journey from Screenshots to Whiteboards

The landscape of artificial intelligence is rapidly evolving. The recent announcement of GPT-4 with vision capabilities by OpenAI stands as a...

Read More
If Software Quality is Everybody's Responsibility, so is Failure

6 min read

If Software Quality is Everybody's Responsibility, so is Failure

In many large organizations, software quality is primarily viewed as the responsibility of the testing team. When bugs slip through to production, or...

Read More
Curiosity's and EVERFI's finalist entry to the North American Software Testing Awards

2 min read

Curiosity's and EVERFI's finalist entry to the North American Software Testing Awards

The project, shortlisted for the "Best Use of Technology in a Project", reduced the time needed to create and run automated tests from weeks to...

Read More
Announcing Model-Based Test Automation for Microsoft Dynamics 365

3 min read

Announcing Model-Based Test Automation for Microsoft Dynamics 365

The introduction of bi-annual major releases for Dynamics 365 bring new features and innovation more regularly to its users. However, it also...

Read More
Curiosity, Omnext and Specialisterren Announce code-less automation

3 min read

Curiosity, Omnext and Specialisterren Announce code-less automation

Curiosity Software Ireland, specialist vendor in model-based testing, today announced its partnership with Omnext, experts in software quality...

Read More