As years go by PII has been changing media, software and so analysis and data retention processes to follow the technological development. In the history of PII it is possible to identify four different periods. Every one of these is characterized by the use of different technologies that don’t mark out an ‘short steps’ improvement with continuous graduated changes, but a ‘step logic’, with not so frequent, but considerable changes, that completely alter the procedures used by the people. Technologies, media, operating systems, drives change, while people are the same. In this way ‘know- how’ and skills stay in few people’s hands and they have the responsibility to record and store the PII data.
Phases identified by different tools and methods to store PII inspections data are: from 1980 to 1992; from 1992 to 1994; from 1994 to 1996; from 1996 to 2001; from 2001 to 2003; from 2003 to nowadays.
4.1 Media, software and process of data retention used from 1980 to 1992
In this period the process used by PII is divided in the followed phases:
1- After the inspection a tape (Fig. 4.1) arrives in PII from field. On the tape are recorded all raw data taken by PIG during the pipeline inspection. In addition, other data, such as features of the vehicle (e.g., speed, technology, type, size) and the pipeline (e.g., material grade, size), can be recorded on this tape.
Figure 4.1: Tape with raw data taken by PIG during the inspection and coming directly from field to PII
2- The tape is put in a record machine called Reel to Reel Tapes (Fig. 4.2), so that two copies are produced. Now Program for Universal Magnetics Analysis (PUMA) is able to read copied data. PUMA is the software used to process data recorded on the tape (Fig. 4.3).
Figure 4.3: Tape with raw data readable by PUMA
3- One of two copied tapes is put in a drive suitable for its reading (Fig. 4.4).
Figure 4.4: Drive suitable for tapes reading
4- Then an employee inserts the parameters needed for realizing processing data by software.
5- PUMA reads, processes and inserts data in a Virtual Address eXtension machine (VAX) (Fig. 4.5). This mainframe uses a VMS operating system.
Figure 4.5: VAX Machine and its devices
6- Processed data are printed by plotter on a paper (Fig. 4.6) and are reproduced by waves. During the data processing PUMA generates also a Defect List Summary file (DLS File), where information about the inspection is listed in the shape of numbers (e.g., anomaly location, size) (Fig.4.7) and showed by waves on paper.
Figure 4.7: DLS File generated by PUMA during data processing
7- Analysts take the paper with the waves and analyse the data. They draw by hand boxes where there are critical points and anomalies.
8- After the analysis the DLS File is updated and completed with missing data. This is removed from VAX and recorded on other two tapes (Fig. 4.8) stored in two different places.
Figure 4.8: Tape with analysed data
9- Then a Final Report of the inspection is written. One copy of this is stored by PII, other is given to the client. At the end PII has: 1 tape from field with raw data of inspection; 2 tapes with raw data in a format readable by PUMA(Fig. 4.3); 2 tapes with analysed data (Fig. 4.9); the Final Report on paper. The tape from the field, one copy of readable raw
data, one copy of analysed data and Final Report are stored in the ‘Computer Room’, inside the main building, and the other copies in a storehouse near the main building.
Figure 4.9: Space of the Computer Room where tapes with raw and analysed data are stored
4.2 Media, software and process of data retention used from 1992 to 1994
In this period the process used by PII is divided in the followed phases:
1- After the inspection a tape (Fig. 4.1) arrives in PII from field. On the tape are recorded all raw data taken by PIG during the pipeline inspection. In addition, other data, such as features of the vehicle (e.g., speed, technology, type, size) and the pipeline (e.g., material grade, size), can be recorded on this tape.
2- The tape is put in the record machine called Reel to Reel Tapes (Fig. 4.2), so that two copies are produced. Now copied data are readable by PUMA and recorded on TA90 (or 3480) cartridges (Fig. 4.10).
Figure 4.10: TA90 (or 3480) cartridges
3- One of two copied tapes is put in a Cartridge Drive suitable for its reading (Fig. 4.11).
Figure 4.11: Different types of Cartridge Drive owned by PII
4- Then an employee inserts the parameters needed for realizing processing of data by software.
5- PUMA reads, processes and inserts data in a VAX machine (Fig. 4.5) joined to Cartridge Drives (Fig. 4.11). This mainframe uses a VMS operating system.
6- Processed data are printed by plotter on a paper (Fig. 4.6) and are reproduced by waves. During the data processing PUMA generates also a DLS File, where information about
the inspection is listed in shape of numbers (e.g., anomaly location, size) (Fig. 4.7) and showed by waves on paper.
7- Analysts take the paper with the waves and analyse the data. They draw by hand boxes where there are critical points and anomalies.
8- After the analysis the DLS File is updated and completed with missing data. This is removed from VAX and recorded on other two TA90 (or 3480) cartridges stored in two different places.
9- Then a Final Report of the inspection is written. One copy of this is stored by PII, other is given to the client. At the end PII has: 1 tape from field with raw data of inspection; 2 TA90 (or 3480) cartridges with raw data in a format readable by PUMA (Fig. 4.10); 2 TA90 (or 3480) cartridges with analysed data (Fig. 4.10); the Final Report on paper. The tape from the field, one copy of readable raw data, one copy of analysed data and Final Report are stored in the ‘Computer Room’, inside the main building (Fig. 4.12), and the other copies in a storehouse near the main building (Fig. 4.13).
Figure 4.13: Space of the Storehouse near the main building to store TA90 cartridges
Observation:
In this period, data of previous inspections stored on disks are copied on TA90 cartridges. At the beginning four copies are produced: two per raw data readable by PUMA and two per analysed data.
Disks are thrown away and the copied cartridges are stored two in the Computer Room and two in the storehouse near the main building.
Later, PII concludes that it spends to much time and money for this procedure and decides to realize just one copy per raw and one copy per analysed data.
Now only two disks are thrown away.
In this way there are two copies of raw data and two copies of analysed data, one on disk, one on TA90 cartridge.
Disks are stored in the Computer Room inside the main building (Fig. 4.14), cartridges in the storehouse near the main building.
Figure 4.14: Space to store disks and cartridges inside the Computer Room
4.3 Media, software and process of data retention used from 1994 to 1996
In this period the process used by PII is divided in the followed phases:
1- After the inspection a little tape (Fig. 4.15, 4.16) arrives in PII from field. On the little tape are recorded all raw data taken by PIG during the pipeline inspection. In addition, other data, such as features of the vehicle (e.g., speed, technology, type, size) and the pipeline (e.g., material grade, size), can be recorded on this tape.
Figure 4.15: Shelves in the storehouse near the main building where the little tapes coming from field are stored.
Figure 4.16: Little tape coming from field.
2- The little tape is put in a tape drive called DAT Drive (Fig. 4.17), so that two copies are produced. Now copied data are readable by PUMA and recorded on TA90 (or 3480) cartridges (Fig. 4.18).
Figure 4.17: DAT Drive
Figure 4.18: TA90 cartridge
3- One of two copied tapes is put in a Cartridge Drive suitable for its reading (Fig. 4.11). 4- Then an employee inserts the parameters needed for realizing processing of data by
software.
5- PUMA reads, processes and inserts data in a VAX machine (Fig. 4.5) joined to Cartridge Drives (Fig. 4.11). This mainframe uses a VMS operating system.
6- Processed data are printed by plotter on a paper (Fig. 4.6) and are reproduced by waves. During the data processing PUMA generates also a DLS File, where information about the inspection is listed in the shape of numbers (e.g., anomaly location, size) (Fig. 4.7) and showed by waves on paper.
7- Analysts take the paper with the waves and analyse the data. They draw by hand boxes where there are critical points and anomalies.
8- After the analysis the DLS File is updated and completed with missing data. This is removed from VAX and recorded on other two TA90 (or 3480) cartridges stored in two different places.
9- Then a Final Report of the inspection is written. One copy of this is stored by PII, other is given to the client. At the end PII has: 1 little tape from field with raw data of inspection; 2 TA90 (or 3480) cartridges with raw data in a format readable by PUMA(Fig. 4.10); 2 TA90 (or 3480) cartridges with analysed data (Fig. 4.10); the Final Report on paper. One copy of readable raw data, one copy of analysed data and Final Report are stored in the ‘Computer Room’, inside the main building, the little tape from field and the other copies are stored in a storehouse near the main building.
Observation:
Because of the introduction of little tapes from field and the new drive for reading and recording, the retention of old disks with raw data readable by PUMA becomes no more important. The main reason is that the drive used for reading and recording on disks does not work anymore.
However some of these disks are not thrown away yet, because of contractual obligations. They demand that PII should store them for an endless time.
4.4 Media, software and process of data retention used from 1996 to 2003
Since 1996 PII has taken a step forward in soft wares for viewing and analysing processed data.
In this period the process used by PII is divided in the followed phases:
1- After the inspection a little tape (Fig. 4.15, 4.16) arrives in PII from field. On the little tape are recorded all raw data taken by PIG during the pipeline inspection. In addition, other data, such as features of the vehicle (e.g., speed, technology, type, size) and the pipeline (e.g., material grade, size), can be recorded on this tape.
2- The little tape is put in a tape drive called DAT Drive (Fig. 4.17), so that two copies are produced. Now copied data are readable by PUMA and recorded on DLT cartridges. They are labelled with the ‘P’ letter (Fig. 4.19).
Figure 4.19: DLT cartridge with data coming from field
3- One of two copied tapes is put in a Cartridge Drive suitable for its reading (Fig. 4.20).
Figure 4.20: Some different DLT drives owned by PII
4- Then an employee inserts the parameters needed for realizing processing of data by software.
5- PUMA reads, processes and inserts data in a VAX machine (Fig. 4.5) joined to Cartridge Drives (Fig. 4.11). This mainframe uses a VMS operating system.
6- Processed data are displayed by waves directly on the analyst’s screen. This because Dataview viewer is now introduced (Fig. 4.21). In this way analysts can analyse data by computer and not by hand on paper. Then Dataview updates DLS File automatically from the analysts’ computers, without needing to go to the computer room and updating this from VAX devices.
Figure 4.21: Viewer Dataview
7- Analysed data are removed from VAX and recorded on other two DLT cartridges stored in two different places. Then two CDs are recorded and the Final Report of the inspection is written by PII. The client receives one CD and the Final Report. At the end PII has: 1 little tape from field with raw data of inspection; 2 DLT cartridges with raw data in a format readable by PUMA(Fig. 4.19); 2 DLT cartridges with analysed data (Fig. 4.19); the ‘Final Report’ CD. One copy of readable raw data, one copy of analysed data and ‘Final Report’ CD are stored in the ‘Computer Room’, inside the main building (Fig. 4.22), the little tape from field and the other copies are stored in a storehouse near the main building.
Figure 4.22: Shelves in the Computer Room with DLT cartridges (type ‘P’), holding data from field, and DLT cartridges (type ‘D’), holding analysed data
record and analysis of data.
Both data, analysed by VAX or PC, are recorded on a DLT cartridge. DLT cartridges are differentiated by a label. Letter ‘D’ indicates cartridges holding data recorded with ‘VAX procedure’ (Fig. 4.23), letters ‘PC’ cartridges holding data recorded with ‘PC procedure’ (Fig. 4.24).
Figure. 4.23: DLT holding data processed by VAX Figure 4.24: DLT holding data processed by PC
The process used by PII to implement PC in the ‘Data Retention’ is divided in the followed phases:
1- After the inspection a little tape (Fig. 4.15, 4.16) arrives in PII from field. On the little tape are recorded all raw data taken by PIG during the pipeline inspection. In addition, other data, such as features of the vehicle (e.g., speed, technology, type, size) and the pipeline (e.g., material grade, size), can be recorded on this tape.
2- The little tape is put in a tape drive called DAT Drive (or RDAT Drive) (Fig. 4.17). This drive is joined to a PC that uses Windows operating system. Now two copies of raw data are no more produced before the new software processes them. The software taking the place of PUMA is PipeRead (Fig. 4.25, 4.26).
Figure 4.25: Window of PipeRead showing information about the inspection
Figure 4.26: Monitoring the processing of inspection data
3- Then an employee inserts the parameters needed for realizing processing of data by software.
Figure 4.27: PipeImage Viewer
Figure 4.28: PipeImage Viewer displaying anomalies of pipelines with boxes: Ovals, for internal defects, Rectangles, for external defects
5- Analysed data are removed from the hard disk of the PC and recorded on other two DLT cartridges stored in two different places. Then two CDs are recorded and the Final Report of the inspection is written by PII. The client receives one CD and the Final Report. At
1
There is not a detailed explanation about the corrosion analysis because it isn’t topic of the project. Besides, PII did not go into this aspect during the internship, because it was for PII analysts.
the end PII has: 1 little tape from field with raw data of inspection; 2 DLT cartridges with raw data (Fig. 4.23, 4.24); 2 DLT cartridges with analysed data (Fig. 4.23, 4.24); the ‘Final Report’ CD. One copy of raw data, one copy of analysed data and the‘Final Report’ CD are stored in the ‘Computer Room’, inside the main building (Fig. 4.29), the little tape from field and the other copies are stored in a storehouse near the main building.
Figure 4.29: Shelves in the Computer Room where DLT cartridges (type ‘PC’) holding processed data are stored
4.6 Media, software and process of data retention used from 2003 to nowadays
In this period the process used by PII ’ is divided in the followed phases:
1- After the inspection a little tape (Fig. 4.15, 4.16) arrives in PII from field. On the little tape are recorded all raw data taken by PIG during the pipeline inspection. In addition, other data, such as features of the vehicle (e.g., speed, technology, type, size) and the pipeline (e.g., material grade, size), can be recorded on this tape.
2- The little tape is put in the tape drive called DAT Drive (or RDAT Drive) (Fig. 4.17). This drive is joined to a PC that uses Windows operating system. As well as in the previous period two copies of raw data are no more produced before the software processes them. Software used is always PipeRead.
3- Then an employee inserts the parameters needed for realizing processing of data by software.
Figure 4.31:CDS Hardware
5- After having verified that data are processed correctly and parameters inserted for automatic creation of boxes by software are appropriate the analyst can begin the analysis.
6- Then one CD is recorded and the Final Report of the inspection is written by PII.
7- Raw (in SIG File format), processed, analysed data and the ‘Final Report’ (in pdf format) are saved in CDS directly and then two copies of all are recorded on LTO cartridges (the machine used is LTO3) (Fig. 4.32, 4.33).
Figure 4.32: LTO3 cartridges
8- At the end PII has: 1 little tape from field with raw data of inspection; 2 LTO cartridges with raw, processed, analysed data and the ‘Final Report’. One LTO cartridge is stored in the ‘Computer Room’, inside the main building, the other in an external storehouse, near Cramlington. The little tape from field is stored in the storehouse near the main building.
4.7 Procedures for conversion and transfer data of previous inspection to the new media used by PII
During the years PII has been changing media, software and so analysis and data retention processes to follow the technological development.
But now the company has to deal with a considerable problem and for this reason it is putting into practice a procedure for converting and transferring all data of previous inspections to LTO cartridges.
Reasons why it is incline to this solution are:
1- The tape cartridges where previous inspection data are stored are physically deteriorating; 2- The previous tape drives (just before LTO3) will be unsupported after May 2007 and only few experienced analysts remain in PII who can perform the translation re-processing tasks.
Different procedures for transferring and, eventually, converting inspection data are used during the life of the company. What procedure is used depend on the period and technologies.
4.7.1 Procedure used to transfer the data from 1980 to 1996
The following procedure is used to transfer the data of this period:
1- Analysed inspection data of this period are not transferable, because they are recorded and saved on not convertible tapes and readable with the old machine only.
For this reason is necessary to go back up to copied cartridge with raw data coming from field directly.
2- The cartridge is inserted in VAX. The up-to-date PUMA software generates some files of data (e.g. DLS-Defect List Summary, PLM-PipeLine Map File). Some of these files could not be generated before. The main file among these is CSF (Clustered Signal File), that allows to display by means of waves the deterioration level of the pipeline.
3- Through the use of PUMA Convert software data are converted and displayed in the PipeImage format (format used at present).
4- At this point the analyst analyses data for a second time and saves these in CDS and on LTO3 cartridges.
4.7.2 Procedure used to transfer the data from 1996 to 2003
The following procedure is used to transfer the data of this period:
1- Unlike previous period the analysed inspection data of this period are transferable through conversion on LTO3 cartridges.
2- These analysed, recorded on DLT cartridges and displayed with Dataview data are inserted in VAX and converted directly through PUMA Convert software in a PipeImage format.
3- At this point data are saved in CDS and on LTO3 cartridges without they need further analyses.
4.7.3 Procedure used to transfer the data from 2001 to 2003
As above written years from 2001 to 2003 were of transition and saw a parallel use of two methods for data retention: ‘traditional’ one, ‘innovative’ the other. The transfer of data to LTO3 cartridges is required also for the ‘innovative’ method.
The following procedure is used to transfer data:
