TestProNews Q3 - 2006
Five Reasons Why You Need a Test Data Management System
Automated test systems have one thing in common; they generate copious amounts of
test data that can be chaotic if not managed properly. Data generated by automated
test systems must be captured in order to provide a historical record of what devices
and tests were performed. Captured data must be organized, analyzed and evaluated
to learn how the device performed versus specifications. Raw test data must be converted
into information that managers and engineers can easily access to make intelligent
decisions necessary to improve product performance, increase quality, reduce costs
and speed time to market. A test data management (TDM) system facilitates the process
of capturing, organizing, analyzing, accessing and evaluating large volumes of test
data and making sense of the data.
All too often TDM is an afterthought. Many times the need for a TDM system is not
appreciated until after the automated test system is up and running and generating
heaps of data. This often results in companies seeing a loss of productivity, efficiency
and increased development costs. This article identifies five of the most common
reasons why you need a TDM system and how it can help eliminate these problems.
1. I manage large quantities of disparate data from many different test systems.
Resolving data disparity issues and creating an integrated data repository are key
to improving the quality of your test data resources. A “one size fits all” universal
data format for storing test results generated by automated test systems does not
exist. Data generated by automated test systems is based on specific application
requirements, and therefore each system handles formatting and storing of the resulting
test data differently compounding the problem. Installing new test systems simply
magnifies the problem because disparate data are created faster than they can ever
be resolved. Companies must define corporate-wide standards and systems to get a
handle on this problem.
A key feature of TDM software such as Arendar is leveraging an industry-standard
relational database as the common data repository for all test data. This method
has the benefit of enforcing a structured data approach with a known data architecture,
data descriptions and schema effectively eliminating the disparate data issue. A
file-based approach is an alternative method commonly used for capturing test data
from a single test station. The pros and cons of both methods are detailed in the
cover story File vs Database Options for Test Data Management in this newsletter.
2. I can’t find the test data when I need it.
Companies increase their productivity and efficiency and reduce development costs
when they consolidate their design and manufacturing test data across departments
and the organization as a whole. All too often data from automated test systems
used in design, validation and manufacturing are captured and stored on multiple
computers scattered across different departments. This makes it extremely difficult
to locate a particular data set, perform analysis, correlation and derive decisions
from it. An enterprise TDM system consolidates test data across the enterprise and
provides a unified view and secure access to test data. Other benefits include:
|
Sharing test data between multiple users at different locationsSharing test data between multiple applicationsReal-time web access to test data for analysis and decision
makingIncreased system scalability and security
|
A key advantage of a database TDM system architecture is that all test data is consolidated
into a unified repository that provides users with immediate and secure Web access
to the data for analysis and reporting anytime and anywhere.
3. Our engineers are very busy and I can’t get reports I need in a timely fashion.
A key problem for test engineers and managers is "data chaos." Automated test systems
create massive amounts of test data that quickly becomes unmanageable, difficult
to access and time consuming to transform into meaningful information and reports.
Without proper TDM tools, test engineers face a variety of problems trying to compile
and analyze data and create reports in a timely fashion. If your engineers are spending
hours or days collecting, organizing and formatting test data for analysis and reports,
a TDM system makes life much easier for them. An enterprise TDM system stores test
data into a database that provides managers and engineers easy real-time access
for searching, correlating, analyzing and examining test results and generating
reports.
One of the biggest disadvantages that users of automated test systems experience
are the inefficiencies associated with retrieving data and reports from the system.
Because the data is not organized in a consistent manner or in a format that facilitates
drilling through multiple files, finding, correlating, and comparing your data can
be a tedious process even with the greatest search capabilities. This becomes even
more of a problem as data is spread out over different test stations.
4. My test engineers aren’t IT experts and I don’t want to depend on our IT group for support.
Test engineers are experts on measurement and test technologies and know what’s
needed to develop test processes and test plans to ensure their company’s product
meets design specifications and quality metrics. Enterprise TDM systems leverage
relational database, Web, business intelligence and other information technology
(IT) not generally used in automated test systems. Arendar is designed for test
engineers and does not require extensive IT expertise to use. TDM software such
as Arendar hides the complexity of underlying information technology by providing
graphical database configuration and test data import utilities, Web-based data
query, viewing and report generation tools that can be used by managers and engineers
without having to be a database or IT expert.
5. My test engineers are spending too much time developing test databases when they should be improving our test performance.
Most test data management systems in use today are custom software developed by
in-house development groups. An off-the-shelf TDM product like Arendar did not exist
when many of these home-grown TDM systems were developed. Companies were able to
justify the use of internal development resources on non "core competency" development
because they realized the strategic value of a TDM system to their business. Global
competition, cost reductions, downsizing and refocus on core business competencies
have made companies realize that their home-grown TDM software is very expensive
and difficult to maintain and support. Because of these problems, companies are
looking for an off-the-shelf TDM product that comes with vendor support and training
that they can buy rather than build themselves.
In summary, the key advantages of an enterprise test data management system include:
|
Organizational efficiencies gained by consolidating test
data from a variety of sourcesThe ability to deliver secure Web access to test data across
the enterprise
Web-based ad-hoc query and report tools give users an interface
they understand and acceptBuilt-in security prevents unauthorized users from accessing
sensitive informationBetter utilization of test data and resourcesBetter product and business decisions based on real-time
informationBuying instead of building from scratch leverages proven
commercial productsIncreases in the overall value of test data across the
organization |
An off-the-shelf product such as Arendar provides an easy-to-use, cost-effective,
scalable test data management solution to help you manage design and manufacturing
test data across your enterprise
Ask the Expert
Email questions concerning this article to:
expert.testpronews@vi-tech.com
|
|
|
|
Read about the latest information for integrating automated test systems throughout the enterprise. |
|
|
|
 |
Download PDF |
|
|
