tag:blogger.com,1999:blog-8951904624959546499.post899391200681612785..comments2024-02-22T05:36:59.121-05:00Comments on Test This Blog - Eric Jacobson's Software Testing Blog: Design Test Automation Around Golden MastersEric Jacobsonhttp://www.blogger.com/profile/08216361684596485033noreply@blogger.comBlogger6125tag:blogger.com,1999:blog-8951904624959546499.post-78629085656161501982014-11-27T16:34:18.918-05:002014-11-27T16:34:18.918-05:00This can also be used at the UI level with imaged ...This can also be used at the UI level with imaged based comparison. It is possible to do pixel based comparison with a golden master. A good way to catch visual regressions. You can have your automated UI test take a screen shots and you can identify your golden master. Then you can have your automated test run, take snapshot and your comparison logic can compare them and fail if the threshold for pixel difference is crossed. There are a few production ready tools that can do this. I have actually written a tool and it was easier than I thought. <br /><br />So, the golden master is a very valuable and efficient was to to quickly test regressions in a variety of types of automated tests.Anonymoushttps://www.blogger.com/profile/18089480968074676379noreply@blogger.comtag:blogger.com,1999:blog-8951904624959546499.post-66228620752490846342014-10-15T02:14:46.694-04:002014-10-15T02:14:46.694-04:00I would think at a granular level, this could appl...I would think at a granular level, this could apply to unit, API, integration tests that are more developer centric as well?man9ar00https://www.blogger.com/profile/12846267464022901501noreply@blogger.comtag:blogger.com,1999:blog-8951904624959546499.post-36524699245960461372014-10-13T10:48:00.855-04:002014-10-13T10:48:00.855-04:00Yep, using a "Baseline" for the A vs. B ...Yep, using a "Baseline" for the A vs. B comparison (actual vs. expected) is an ideal thing to do. Nothing new. Been doing it for years.<br /><br />Sorry, I'm just an olde fart who thinks the renaming/rebranding of terms is just insane right now in the testing world.<br /><br />As a keynote presenter at a conference I attended years ago said "I know 21 languages! All of them English."<br /><br />Good post Eric, sorry if you take this to mean I am slamming on you. I'm not, just pointing out that the vocabulary of testing is out of whack.<br /><br />Regards,<br /><br />Jim HazenCalkelpdiverhttps://www.blogger.com/profile/14278143481367031063noreply@blogger.comtag:blogger.com,1999:blog-8951904624959546499.post-36700767550388441232014-10-10T22:24:29.323-04:002014-10-10T22:24:29.323-04:00Big fan of "golden data" here. You have...Big fan of "golden data" here. You have to make sure that your new code will work with what's set up in prod (at least). It's also helpful for setup and tear down for automation and experimentation.Alexhttps://www.blogger.com/profile/07298916960841993037noreply@blogger.comtag:blogger.com,1999:blog-8951904624959546499.post-69164649580700081452014-10-10T22:23:41.219-04:002014-10-10T22:23:41.219-04:00Big fan of "golden data" here. You have...Big fan of "golden data" here. You have to make sure that your new code will work with what's set up in prod (at least). It's also helpful for setup and tear down for automation and experimentation.Alexhttps://www.blogger.com/profile/07298916960841993037noreply@blogger.comtag:blogger.com,1999:blog-8951904624959546499.post-27419614382952837762014-10-10T18:40:39.281-04:002014-10-10T18:40:39.281-04:00This also works well for applications that output ...This also works well for applications that output XML data or captures events in XML format. You can diff the XML output with the golden file. You can even make your own diff tool where you can give it a list of XML tags to ignore. For example timestamps, date, time are commonly ignored. But sales totals, number of requests, account names, error type, etc would be compared.<br /><br />Moving this into CI then is fairly easy. The golden masters are checked into source code control just like the code for the application under test. If the new version of the application changes the XML, a new version of the XML can be checked in as well after the differences are approved by QA.<br /><br />If you are testing an application that updates a database. At the end of a series of tests(sanity, smoke, regression, etc), the database can be exported to XML and this can be used as a golden master as well.<br /><br />Big Data can use this method as well. The output of a Hadoop job, once verified by QA, can be used as a golden master file.Kevinhttps://www.blogger.com/profile/11191413331575506607noreply@blogger.com