Select measures of effectiveness (MOEs) that are measurable based on what is happening in the supply chain operations as well as in the deployment test.

Columbus, Ohio's experience in the electronic freight management system deployment test.

Date Posted
04/27/2009
TwitterLinkedInFacebook
Identifier
2009-L00472

Columbus Electronic Freight Management Evaluation Final Report

Summary Information

In support of the USDOT Intelligent Transportation System (ITS) Joint Program Office, the Columbus Electronic Freight Management (CEFM) project was intended to test an implementation of a service-oriented architecture supporting real-time freight data exchange, the Freight Information Highway (FIH), in an international air-freight supply chain. The CEFM system is a freight data exchange and information management concept, which relies on the Web-based FIH. CEFM obtains data from each supply chain partner, stores the data separately, and then exchanges the data with other trading partners via Web services using Extensible Markup Language (XML).

The CEFM project covers the entire air cargo supply chain, from overseas suppliers in China to the shippers' distribution centers in Columbus, Ohio. Design and development of CEFM were completed during 2006 and early 2007, and the deployment test was conducted from May 29, 2007 to December 4, 2007. The evaluation included an analysis of the consignment supply chain data that was received and exchanged by CEFM and stored for each partner.

The CEFM evaluation addressed four study areas, which are system usefulness, cargo visibility, supply chain and logistics performance, and deployment and scalability. Each study area has two or more hypotheses and each hypothesis has several Measures of Effectiveness (MOEs).

Lessons Learned

Supply chain and logistics performance evaluation involved comparative analysis between current operations and operations that would be conducted using the information available from CEFM. The following lessons are learned from the evaluation of supply chain performance improvements based on the data obtained from the CEFM.

  • Do not rely on the classic MOEs of supply chain improvement in the deployment test itself. As much as supply chain professionals and government officials want to reduce transit time, improve shipment reliability, and reduce dwell time, which are classic performance measures, the live deployment tests cannot be expected to address these measures sufficiently. Tests that are part of existing operations, as occurred with CEFM, are generally only a subset of the shipment activities, and the users and managers must move the freight first, and then provide support to the test. These measures reflect appropriate goals for the supply chain and could be used in performance evaluation only if the participating companies implemented the system in their operations, but they should not be used in the deployment test itself.
  • Use precaution assessing the benefits as MOEs. The labor savings was one of the benefits can be accrued from the EFM. The labor savings were expected from reduced efforts verifying inadequate or missing data on the warehouse floor, correcting errors in electronic data interchange (EDI) information, and obtaining information about priority shipments. Also, manufactures would have reduced data entry and staff time because fewer data elements need to be entered to book a consignment using CEFM. Even though labor savings were the most quantifiable benefit, the partners in the supply chain had a difficult time providing estimates of realized savings. This experience tells us that the benefits as MOEs need to be evaluated carefully.
  • Manage EFM shipments separately to measure selected MOEs. The evaluation team found that none of the partners thought that the schedules of EFM test shipments were affected, because test shipments were relatively small percentage of the total and no partner made an effort to separately manage those shipments. As the result, it was very difficult to find the indication that EFM had any effect on MOEs during the deployment test.

This lesson strongly recommends the evaluation team to select MOEs that they are measurable based on what is happening in the supply chain operations as well as in the deployment test. Also, the MOEs need to be carefully assessed because various work tasks make hard to measure them. When the target shipments for evaluation are small portion of the total, the target shipments need to be managed separately. Otherwise the MOEs would be of little value.

Columbus Electronic Freight Management Evaluation Final Report

Columbus Electronic Freight Management Evaluation Final Report
Source Publication Date
07/01/2008
Author
K. Troup (North River), D. Newton (SAIC), M. Jensen (SAIC), C. Mitchell (SAIC), D. Stock(SAIC), M. Carter (SAIC), M. Wolfe (North River), and R. Schaefer (SAIC)
Publisher
U.S. Department of Transportation, ITS Joint Program Office, Research and Innovative Technology Administration, 1200 Newe Jersey Ave. SE, Washington, D.C. 20590
System Engineering Elements

Keywords Taxonomy: