Subscribe
The world's leading Process Mining online event

Virtual Conference

August 10-12, 2021

The world's leading Customer Experience Excellence online event

Virtual Conference

September 07-09, 2021

The world's leading Financial Services online event

Virtual Conference

September 28-30, 2021

The world's leading Oil & Gas online event

Virtual Conference

October 12-14, 2021

The world's leading Autonomous Things online event

Virtual Conference

October 19-21, 2021

The world's leading Predictive Analytics online event

Virtual Conference

November 2-4, 2021

The world's leading Artificial Intelligence online event

Virtual Conference

November 16-18, 2021

The world's leading Autonomous Things online event

Virtual Conference

November 30 - December 2, 2021

The world's leading Process Mining online event

Virtual Conference

August 10-12, 2021

Join the largest online meetings ONLY event that connects the entire RPA ecosystem.

Online

November 9-11, 2021

Join the largest Conference and Award program of the Business Transformation & Digital Transformation ecosystem.

Virtual & In-Person,
Renaissance Orlando at SeaWorld®

Dec 13-17, 2021

BTOES Insights Official
By
July 12, 2021

IT Infrastructure & Cloud Strategies Live - SPEAKER'S ARTICLE : Integrating Data Quality Reporting into your Testing Strategy

Courtesy of Beacon Street's, Jon Szymanski wrote a synopsis of her speaking session discussing 'Integrating Data Quality Reporting into your Testing Strategy'.

BLOGS COMPANY LOGO (9)pillar%20page%20line%201

I have spent the last 18 months building a QA team from greenfield in order to support a large, existing tech stack that has been running for six years. My greatest challenges are in the complexity of our software and our lack of stable, accurate, and separate Test environments.
 
We have done our best to deal with these issues. We have over 85% of our system functionality documented in test cases and over 70% of those automated and part of our daily regression runs. But we can’t test everything, and we wouldn’t want to.
 
When we have honest conversations with our stakeholders, affiliates, and customers, the one thing they want the most is …..greater confidence in our software releases and they want to trust the data. In order to provide this as a technology team, we can test more, and we can shift-left to harden our processes with CI/CD and automation as early as possible. And we do that. But as mentioned, we can’t and won’t test everything.
 
My aha moment was realizing we need to do exactly what our customers want and that was…assess our data. This meant focusing “some” time analyzing our production data, thus bypassing just test case execution in the Test environment. Thus was born what we term Data Quality Reporting (DQR) and a conscience decision to shift-right….just a little.
 
2-Apr-21-2021-02-50-40-28-PM-1To reiterate, shifting-left should always be a priority. But we can still take a wholistic approach in our strategy as it is not an “either/or” proposition.
 
So what does DQR look like?
It is a focus on monitoring our processes, providing immediate feedback, and making specific observations. We take a look at business functions that we understand and then build queries and reports based on that knowledge to validate our end result data.
 
For example, supporting subscription based businesses, let’s say we generate an invoice for a customer and expect payment. This process traverses through five different batch jobs, then feeds into a fulfillment process that either provides access to content or revokes it. We can test the five separate processes, but identifying an issue in the full integration test is harder. We have an almost endless set of variations and paths based on our complex business rules. This is where DQR can help.
 
What we do is define the state of the end result and develop a report to run against our production Data Warehouse to identify any data that does not match our expectations. In this example it may be as simple as this:
 
Report query to identify a payment problem
that still allows access to content.
 
We run this report daily and send results only if there are records returned. This becomes our DQR alert to a problem. We can then review the record in the report, review logs and jobs, look for potential edge cases or issues we had not tested for or encountered before, and so on.
 
Writing regression tests takes months. Writing data queries takes minutes. That was a great ROI and allowed us to effectively provide a measure on the confidence of our data.
 
In summary, when we can’t fully manage areas in the early stages of software development, we can shift-right (downstream). And that is not only okay, but our responsibility. We can provide our customers more confidence in the data and it is a quick win! Focus some time on data quality and not just test case execution because thinking beyond just test cases is part of our job!
 
Best,
Jon

pillar%20page%20line%201

About the Author

more - 2021-07-12T151703.588Jon Szymanski,
VP of Software Engineering & QA, 
Beacon Street.

Jon has over 25 years of experience in software engineering, managing and leading both development and testing teams. He has worked for large, billion-dollar companies, as well as consulted with start-ups as they build out their technology stacks from scratch.

Regardless of his title or role, his passion has always been focused on quality. He recently built a new QA team, with a heavy focus on automated testing and CI/CD, and is now back leading several large-scale engineering projects. When not at work, Jon is spending time with his wife, daughter, dog, and watching sports. 

pillar%20page%20line%201


Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Download the most comprehensive OpEx Resport in the Industry

The Largest Leadership-Level Business Transformation & Operational Excellence Event

The Business Transformation & Operational Excellence Industry Awards Video Presentation

Proqis Events Schedule

Proqis Digital

The Business Transformation & Operational Excellence Industry Awards

Welcome to BTOES Insights, the content portal for Business Transformation & Operational Excellence opinions, reports & news.

Submit an Article

24097-Proqis-Media-Pack-Banner-300x300
ACCESS 50 VIDEO PRESENTATIONS
Access all 75 Award Finalist Entires
pdf
BTOES AWARD - NO DATE
BTOES UNIVERSAL GRAPHIC - NO DATE
Subscribe to Business Transformation & Operational Excellence Insights Now
btoes19.png
png
DO NOT TOUCH - SPEX  - Proqis Digital Event Graphics for Forward Schedule Email (25)
7-Jun-01-2021-08-52-30-07-AM
DO NOT TOUCH - SPEX  - Proqis Digital Event Graphics for Forward Schedule Email (22)-1
DO NOT TOUCH - SPEX  - Proqis Digital Event Graphics for Forward Schedule Email (23)
DO NOT TOUCH - SPEX  - Proqis Digital Event Graphics for Forward Schedule Email (24)
png

Featured Content

  • Best Achievement of Operational Excellence in Technology & Communications: IBM
  • Best Achievement of Operational Excellence in Oil & Gas, Power & Utilities: Black & Veatch
  • Best Achievement in Cultural Transformation to deliver a high performing Operational Excellence culture: NextEra Energy
   
Operational Excellence Frameworks and Learning Resources, Customer Experience, Digital Transformation and more introductions
  • Intelligent BPM Systems: Impact & Opportunity
  • Surviving_the_IT_Talent_deficit.png
  • Six Sigma's Best Kept Secret: Motorola & The Malcolm Baldrige Awards
  • The Value-Switch for Digitalization Initiatives: Business Process Management
  • Process of Process Management: Strategy Execution in a Digital World

Popular Tags

Operational Excellence Business Transformation Speaker Presentation Business Excellence Business Improvement Process Management Continuous Improvement process excellence Process Optimization Process Improvement Leadership Enterprise Excellence Lean Change Management Premium Organizational Excellence Business Challenges Lean Enterprise Digital Transformation Lean Six Sigma Award Finalist Case Study Execution Excellence Capability Excellence New Technologies Agile Changing & Improving Company Culture Culture Transformation end-to-end Business Transformation Execution & Sustaining OpEx Projects Leadership Understanding & Buy-In Lack of/Need for Resources Adapting to Business Trends Business Changing Customer Demands Failure to Innovate Integrating CI Methodologies Lack of/Need for Skilled Workers Lack of/Need for Support from Employees Maintaining key Priorities Relationships Between Departments BTOES18 Industry Technology Healthcare BTOES From Home Customer Experience AI Culture Healthcare and Medical Devices Innovation Robotic Process Automation (RPA) IT Process Automation Automation Digital Enterprise Architecture BTOES Video Presentations Exclusive BTOES HEALTH Financial Services Strategy Execution Process Mining iBPM Customer Experience Excellence Artificial Intelligence Report Lean Manufacturing RPAs Manufacturing BPM Digital Transformation Workplace Cloud RPA & Intelligent Automation Live HealthcareTechnologies Robotic Process Automation Transformation Digital Technologies Agility Insurance Machine Learning value creation Cultural Transformation Digital Process Automation IT Infrastructure & Cloud Strategies Systems Engineering Webinar digital operations Business Process Data Process Design innovation execution data management IT Infrastructure IT Infrastructure & Cloud Strategies Live Sustainability Awards Digital Transformation Workplace Live Data Analytics Healthy Culture Insights Article Oil & Gas Covid-19 thought leaders BTOES Presentation Slides Finance Patient Experience Banking and Capital Markets Professional Services Sales Speaker's Interview Blockchain Enterprise Excellence culture Education Health Insurance Interview AI Solution Electricity Innovation in Healthcare Speaker Article Agile Transformation Banking Operational Excellence Model Organizational Learning Python White Paper investment banking BTOES19 Consumer Products & Retail Delivery solution Government Project Management Algorithm Automotive and Transportation Business Environment CAIR (Client Advocacy Insights Robot) Digital Bank Digital Global Enterprise Model (D-GEM) HR Lean Culture Primary Measure of succes User Interface business expansion business process automation revenue growth Adobe Sign Business Intelligence Digital Technology Digital Workforce E-Signatures Global Technology Learning organization Relationship Management Supply Chain Management Transportation Accounts Receivable (AR) Big Data Technology Blue Room Effect CORE Cloud Technology Cognitive learning Creative Passion Days Sales Outstanding (DSO) Digital Experience Financial Health Maintenance Organizations Information Systems Logistics Services Medicare Operational Excellence Example Optimise Business Processes Risk Management Solving Cash Flow with AI transformation journey AI Ecosystem BPaaS Business Analytics Business Benefits CX Capability Corporate Culture Data Entry Digital Network Digital Network Assistant (DNA) Digitization Drinks ERP's Employee Empowerment Government Programs IT Transformation Implementation Intelligent Automation Internet Media NPS Natural Language Processing Net Promoter Score People Engagement Program (PEP!) Program Management Portal (PgMP) Servant Leadership Six Sigma Strategic Priorities Team Work TechXLive stakeholders 3D Thinking AEGIS Database Automated Money Movement Biopharmaceutical BlueFIT Capital Market Case Study Communication Crypto Digitalization ERP Transformation Effective Change Leaders Enterprice Excellence Culture Enterprise architecture as an enabler Filmed Entertainment Industry Finance Global Operations (FGO) Financial Services Software Frameworks Hoshin Planning Hospitality Human Capital Kaizen Event M&A process Natural Gas Infrastructure Operational Excellence (OpEx) Organizational Change Pharmaceutical Pharmaceuticals & Life Sciences Project manager ST-Elevation Myocardial Infarction (STEMI) Strategic Business Transformation Sustainable Growth Team Leader Development Program (TLDP) The New Era of Automation Transformation Initiatives Wealth Protection Products Web Logic Portal Workplace Analytics XaaS eForms eSignatures AI Process BEAM BFARM BTOES17 Banking & Financial Services Big Data Processing

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120

Proqis Digital Virtual Conference Series

View our schedule of industry leading free to attend virtual conferences. Each a premier gathering of industry thought leaders and experts sharing key solutions to current challenges.

Webinars

 

Delivered by Progressive Thought-Leaders

 

Watch On-Demand Recordings For Free

Watch On-Demand Recording - Access all sessions from progressive thought leaders free of charge from our industry leading virtual conferences.
 

Best-In-Class Training

Delivered by the industry's most progressive thought leaders from the world's top brands.
Start learning today!
 

BTOES From Home - On-Demand

The premier Business Transformation & Operational Excellence Conference. Watch sessions on-demand for free. Use code: BFH1120