Enterprise Data & Automation

Better Requirements, Better Tests, Better Data: Better Releases Every Time! 

    robot-excited copy-1     AI Accelerated Automation Scalable AI accelerated test creation for fast software delivery.

    palette copy-1               Test Case Design            Generate the smallest set of test cases needed to test complex systems.

    database-arrow-right copy-3          Data Subsetting & Cloning Extract the smallest data sets needed for referential integrity and coverage.

      sitemap copy-1 Requirements Modelling Model complex systems as complete flowcharts in-sprint.

      lock copy-1                        Data Masking                      Identify and mask sensitive information across databases and files.

      database-sync copy-2      Legacy TDM Replacement Move to a modern test data solution with cutting-edge capabilities.

        plus-box-multiple copy-1         Synthetic Data Generation     On-Demand synthetic data generation for every scenario.

        file-find copy-1                    Data Allocation                  Automatically find and make data for every possible test, testing continuously and in parallel.

          Explore Curiosity's Solutions

          Our innovative quality solutions help you deliver rigorously tested software earlier, and at less cost!

            web-box copy     Web Test Automation Generate targeted tests from reusable libraries and intuitive flowcharts.

            tablet-cellphone copy              Mobile Test Generation      Automated test generation, targeting and maintenance.

            lock copy-1                        Data Masking                      Identify and mask sensitive information across databases and files.

              cloud-cog copy         API Test Automation        Make complex API testing simple, using a visual approach to generate rigorous API tests.

              sitemap copy-1 Requirements Modelling Model complex systems as complete flowcharts in-sprint.

              database-arrow-right copy-3          Data Subsetting & Cloning Extract the smallest data sets needed for referential integrity and coverage.

                television-guide copy          UI Test Automation            Generate rigorous automated tests and visual flowcharts for targeted UI test automation.

                plus-box-multiple copy-1         Synthetic Data Generation     On-Demand synthetic data generation for every scenario.

                file-find copy-1                    Data Allocation                  Automatically find and make data for every possible test, testing continuously and in parallel.

                  Explore Curiosity's Resources

                  See how we empower customer success, watch our latest webinars, read our newest eBooks and more.

                    video-vintage copy                            Webinars                          Register for upcoming events, and watch our latest on-demand webinars.

                    radio copy                                   Podcasts                              Listen to the latest episode of the Why Didn't You Test That? Podcast and more.

                    notebook copy                              eBooks                          Download our latest research papers and solutions briefs.

                      calendar copy                                       Events                                    Join the Curiosity team in person or virtually at our upcoming events and conferences.

                      book-open-page-variant copy                                   Blog                                Discover software testing trends and thought leadership brought to you by the Curiosity team.

                      face-agent copy                     Help & Support                    Find a solution, request expert support and contact Curiosity. 

                        bookmark-check copy                            Success Stories                    Learn how our customers found success with Test Modeller and Test Data Automation.

                        file-document-multiple (1) copy                        Documentation                    Get started with our tools, discover our learning portal and find solutions. 

                        connection copy                      Integrations                      Explore Test Modeller's wide range of connections and integrations.

                          Creating Quality Since 1995

                          Curiosity are your partners when designing, building and rigorously testing complex systems in short sprints!

                            account-supervisor copy                            Meet Our Team                    Meet our team of world leading experts in software quality and test data.

                            calendar-month copy                                   Our History                                Discover Curiosity's long history of creating market-defining solutions and success.

                            check-decagram copy                         Our Mission                          Learn how we aim to revolutionize the quality and speed of software delivery.

                              handshake copy                            Our Partners                    Learn about our partners and how we can help you solve your software delivery challenges.

                              account-tie-woman copy                                        Careers                              Join our growing team of industry veterans, innovators and specialists. 

                              typewriter copy                     Press Releases                    Read the latest Curiosity news and company updates.

                                bookmark-check copy                            Success Stories                    Learn how our customers found success with Test Modeller and Test Data Automation.

                                book-open-page-variant copy                                             Blog                                    Discover software testing trends and thought leadership brought to you by the Curiosity team.

                                phone-classic copy                                Contact Us                                   Get in touch with a Curiosity expert or leave us a message.

                                  Explore Curiosity's Resources

                                  See how we empower customer success, watch our latest webinars, explore our newest eBooks, read our blogs, and more.

                                  Latest Resources


                                  Explore a wide range of the latest resources from the Curiosity team!

                                  Customer Success Stories


                                  Learn how our customers use our tools to achieve success!

                                  Help & Support


                                  Explore the helpful links below if you need any help.

                                  Creating Quality Since 1995

                                  Curiosity are your partners when designing, building and rigorously testing complex systems in short sprints!

                                  Get To Know Curiosity


                                  Explore our history, learn about our team and the latest Curiosity news!

                                  Customer Success Stories


                                  Learn how our customers use our tools to achieve success!

                                  Connect With Us


                                  Reach out to our team or keep up to date with our latest news!

                                  5 min read

                                  Experiments with GPT Vision for Modelling: A Journey from Screenshots to Whiteboards

                                  Featured Image

                                  The landscape of artificial intelligence is rapidly evolving. The recent announcement of GPT-4 with vision capabilities by OpenAI stands as a groundbreaking development in multi-modal language models. Although this feature is still in its preview phase, the Curiosity team is always on the lookout for innovative solutions. We were immediately captivated and excited by the potential of integrating this advanced technology into our Test Modeller product.

                                  Our journey with GPT-4 began with a simple, yet ambitious, goal: to explore and understand how this cutting-edge AI could enhance our capabilities in model-based testing and quality assurance. In this blog, we showcase some of our early experiments using GPT-4's vision capabilities within Test Modeller - a tool designed for collaborative, quality-focused development.

                                  Preview #1: Screenshots to Models

                                  In the realm of software development, it's rare to start a project from scratch. More often, we find ourselves needing to model existing applications or business logic. This led us to an intriguing question: How effectively could OpenAI's GPT Vision handle the task of creating models from screenshots of existing applications?

                                  To put this to the test, we chose a practical example: a registration form from an ecommerce system. Our goal was to convert this form into a model using GPT Vision. By feeding the screenshot into the system, the co-pilot efficiently analysed and translated the form image into a linear model.

                                  This model served as an excellent starting point but does not give full coverage over how the system reacts to different inputs, and the underlying business logic which ultimately triggers error or success conditions. This is where the power of modelling comes into play, with the ability to further refine and develop the model with SME knowledge of negative scenarios and edge cases, rapidly creating complete system specifications that can then auto-generate tests.

                                  Preview #2: Flowcharts from Non-Exportable Applications

                                  A common hurdle in software development and process documentation is dealing with applications that lack export capabilities. These applications, often critical to business operations, become siloed due to their inability to integrate or share data seamlessly with other systems. This limitation not only hampers the efficiency of workflow documentation, but also leads to a significant increase in manual effort and potential for error.

                                  We un-silo this information by importing computer-generated flowcharts directly into Modeller. This process begins by creating visual representations of the application's processes, which are then fed into the system. The co-pilot intelligently analyses these visuals, interpreting and converting them into detailed, editable flowcharts within our modelling tool.

                                  This approach is particularly effective for applications that are visually rich, but lack the necessary export functionalities. Bypassing the need for manual data entry or complex integration solutions, we can swiftly convert static images into dynamic, interactive models that accurately reflect the application's workflows. It also yields very good results as the image is computer generated and therefore by nature is inherently a much easier vision problem to solve.

                                  Preview #3: Wireframes to Flowcharts

                                  The transition from design wireframes to comprehensive flowcharts is a crucial step in the model-based testing process. Wireframes are the skeletal framework of a digital application, outlining its structure and layout, without delving into the finer details of design. Our challenge was to convert these wireframes into detailed flowcharts that not only represent the structure, but also encapsulate the application's flow and functionality.

                                  The system takes the wireframes and intelligently interprets them, identifying key elements like navigation menus, input fields, and user interaction points. From these elements, modeller co-pilot constructs a flowchart that maps out how these components interact and connect, turning a static layout into a dynamic flow of processes.

                                  One unique challenge in this process is ensuring that the nuances of a wireframe are accurately captured in the flowchart. Wireframes are often high-level and may not include detailed information about every user interaction. Secondly, the wireframes rarely contain business logic which ultimately sits behind a front-end design.

                                  Preview #4: Whiteboard to Flowcharts

                                  Whiteboarding is a key, collaborative approach to ideation and design for most enterprises today. Using GPT-4's vision capabilities, we capture these initial bursts of creativity and structure them into actionable models.

                                  We achieve this by taking images of the whiteboard drawings and importing them into Test Modeller using the modeller co-pilot. This technology allows us to convert these often chaotic and unstructured drawings into clear, organized flowcharts and models.

                                  The process begins with a simple photograph of the whiteboard. Modeller co-pilot then analyses the content, deciphering text, diagrams, and even hastily drawn shapes. It intelligently recognizes the relationships and hierarchies within these drawings, transforming them into a digital format that serves as the starting point for more detailed models.

                                  While this feature has opened new avenues in capturing and digitizing spontaneous ideas, it's important to acknowledge its current limitations. The accuracy of converting these drawings into models largely depends on the clarity of the whiteboard sketches. In instances where drawings are overly abstract or text is illegible, the system may face challenges in accurately interpreting the content.

                                  Human-centric development, AI acceleration

                                  In our exploration of GPT Vision through our co-pilot functionality in Modeller, we've made significant strides in enhancing the modelling processes with additional sources of data which often exist in images. From transforming application screenshots into detailed models and importing flowcharts from non-exportable applications, to converting wireframes and whiteboard sketches into structured flowcharts, each method has showcased the power of AI.

                                  A key insight drawn from all of these examples is the inherent limitation of relying solely on image-based data. This underscores the critical role of having human expertise in the loop, to scrutinize AI-generated results and refine them with the knowledge of Subject Matter Experts (SMEs). This is essential in ensuring high quality and accuracy of any AI generated content.

                                  The synergy between AI capabilities and human expertise through modelling paves the way for a more accurate, and accelerated approach to software quality. To join Curiosity on our journey to create this synergy at enterprise scale, book a time to speak with one of our experts today:

                                  Schedule a Demo