TestProNews Q4 - 2005
What to Look For in Your Enterprise Test Data Management Solution
Because important information such as product characterization, performance, quality
and yields derived from an enterprise test data management (TDM) system impacts
so many different groups and users in your company, it is important to know what
to look for beyond the TDM software technical capabilities (Figure 1).
Off-the-shelf TDM Products Versus "consultingware"
Is this TDM solution a robust off-the-shelf product? When considering TDM
solutions, make sure you are not actually paying for a service contract to develop
a custom TDM solution disguised as an off-the-shelf product. Off-the-shelf TDM products
that will have significantly more features and stability. Consider the difference
in quality and features you would get for the same price if you asked a service
company to design a spreadsheet specific to your application, versus purchasing
a copy of Microsoft Excel. Because an off-the-shelf TDM product is used by hundreds
of people at many different companies, a standard product offers the benefits of:
Many more features for the priceBetter usability because of customer feedbackBetter reliability due to broader usage
|
|
Figure 1: Checklist of what to look for beyond the TDM software technical capabilities |
Secure and Reliable Data
Is my data secure? Be sure your TDM system delivers security and reliability
for all data transactions (Figure 2).
Make sure your TDM system actually stores your data in an industry-standard relational
database such as Microsoft SQL Server or Oracle instead of using a proprietary flat
file data storage approach. Flat-file based systems typically involve the creation
of multiple files and folders resulting in increased complexity, poorly organized
and hard to access data, and inevitable data loss.
An industry-standard database assures the reliability of data stored in the database.
However, also ascertain the TDM system's level of data transfer reliability, which
is the ability to guarantee your data is transferred from the test station to the
server and from the server to your desktop, even in the case of computer, network,
or server fault. Technologies such as Microsoft Message Queue (MSMQ) guarantee data
reliability while other technologies such as Web services have promise for TDM applications
in the future, but do not currently guarantee data reliability1.
|
Figure 2: Make sure the TDM solution guarantees the security and reliability of your test data in transfers and storage. |
Data security restricts access of your data both during data transfer and in the
database. You may have data and reports that you only want your design group to
access. This limited access could be a matter of keeping information private or
just a matter of convenience so that individual users only see the data and reports
that is relevant to them. To prevent data deletion and loss, make sure your TDM
system provides security features allowing only you or those you choose to change,
delete or reorganize your test data and data structures.
Data Accessibility
Is my data easy to access, even through a web browser? The TDM system is
used by many different people in your company so information in the TDM system must
be easily and securely accessible. The TDM system allows you to securely access
your test data in the TDM system database on any networked computer using a standard
web browser, eliminating the need to install special client application software
(Figure 3).
Figure 3: A TDM system with web accessibility allows you to securely access test data and reports through a standard web browser such as Microsoft Internet Explorer from any computer. |
Open Architecture and Extensibility
Can I develop custom add-ons if I choose? Even though standard features
of off-the-shelf TDM software usually cover all customer requirements, you may want
the capability to integrate legacy application software or develop special add-ons
in order to customize your TDM solution to meet your needs. Check if your TDM software
provides a well documents application programming interface (API) that allows you
to easily develop custom software add-ons and interfaces to other third-party applications
when required (Figure 4).
Figure 4: VI Technology's Arendar Test Data Management customer's have used Arendar's open architecture and documented API to add unique capabilities, specific to your application. |
Third-Party Test Development and Analysis Software Integration
Can I easily integrate the TDM system with my test development and analysis software?
Check if the TDM software has good third-party integration which can include automatically
generating source code to easily interface with test development software such as
LabVIEW, LabWindows/CVI and Visual Studio. Net. Make sure the TDM software provides
standard templates and integration modules for interfacing with test sequencing
software, for example, process models for TestStand. The TDM software should also
provide seamless integration with popular third-party engineering and statistical
analysis software tools such as Microsoft Excel.
Scalability
Can the TDM solution scale as I add other departments to the system or as my company
grows? Scalability is an important TDM system consideration especially
if you want to start small with a single user configuration running on one test
station. With good scalability, you have the capability to ultimately grow the system
into a global TDM system collecting, organizing, and reporting on data from hundreds
of test stations located around the world (Figure 5).
|
Figure 5: TDM system scalability gives you the capability to start with one test system and expand into a global TDM system collecting, aggregating, and reporting on data from hundreds of test stations located around the world. |
Dependency on the TDM Supplier
Does this TDM solution give me independence from the supplier? Look for
TDM software that gives you the ability to install, configure, and modify the TDM
system yourself, without requiring the services of another company. You don't want
to call in the TDM supplier every time you need to make a small change.
If you have large system needs and want to outsource the installation and configuration
of an enterprise TDM system, be sure the TDM supplier directly offers these professional
services. The TDM supplier has the most skill and experience in TDM systems and
also has a vested interest in making sure you are successful with their product.
The Company
Am I assured that this TDM company will be in business tomorrow? Nowhere
has there been so many companies come and go as in the enterprise software area.
You want to make sure your TDM company has proven their business model by offering
solutions for at least ten years. A company's proven track record helps guarantee
their stability and longevity to stay in business to continue enhancing their TDM
software and providing you with ongoing support.
A company with years of automated test and test data management experience also
offers lots of advantages by leveraging their extensive domain experience in designing
and deploying enterprise TDM systems over the years.
Conclusion
Off-the shelf enterprise TDM software has evolved to a point that you can get enormous
benefits from a proven product versus building your own system or contracting a
service organization to create a custom TDM system. When considering your next TDM
system choose a product that gives you the most flexibility and independence from
the supplier. Make sure they are committed to the continued evolution and support
of their product as new technologies such as databases, security, and fail-safe
web services emerge. Company stability, longevity and experience are crucial in
order to provide you with ongoing product and application support.
1 Web Services: The SCRAM Generation by Roger Sessions
The ObjectWatch Newsletter, Issue #48 - November 2004
Available at
objectwatch.com/newsletters/ObjectWatchNewsletter048.pdf
Ask the Expert
Email questions concerning this article to:
expert.testpronews@vi-tech.com
|
|
|
|
Read about the latest information for integrating automated test systems throughout the enterprise. |
|
|
|
 |
Download PDF |
|
|
