8 Replies Latest reply on Jun 27, 2018 12:40 PM by Steve Boyko

    repairing missing data in pi archive

    KEVING1958

      We have at our plant a BLUE PI Server on the Control Network that receives all our PI Data from the Control Network.  This BLUE PI Server passes data to our RED PI Server via an OWL Data Diode using a FileTransfer setup.  In the Blue PI Server, we have 2 months worth of Archived Data

       

      We were working on the RED PI Server the other day and caused it to freeze up for 2 days, where the data did not change for any of the tags for over 2 days.

       

      How do I rebuild the Archive on the RED PI Server using the stored short-term Archive off the BLUE PI Server?

        • Re: repairing missing data in pi archive
          James Devine

          Hi Kevin:

           

          The elegant way is to utilize a PI to PI interface that replicates the archive data on the "BLUE" PI Server to the "RED" PI server. Your description seems to indicate there is a myriad of firewall issues preventing its use, but this solution would avoid the problem you described henceforth in perpetuity.

           

          Another Option, depending on the number of tags and the frequency of the data one could utilize PowerShell scripts or Excel VBA scripts to extract data from the "BLUE" PI Server and back-fill the same tags on the "RED" PI Server. Be aware this option would be a patient process and necessarily requires testing before back-filling all the tags with the extracted data.

           

          It does not sound like the BLUE and the RED PI Servers are two nodes of a collective, but if they are one can utilize a "piarchss" command line or batch file that would extract from the archives from the BLUE PI server and back-fill the archives for the prescribed time range on the RED PI server.

          1 of 1 people found this helpful
          • Re: repairing missing data in pi archive
            Steve Boyko

            I understand that with the Data Diode, a PI to PI solution is not possible.

             

            From your description, your PI data is being passed from BLUE to RED via file transfer. Could you not manually run whatever export program is being run on BLUE to generate these files?

            • Re: repairing missing data in pi archive
              scoxey

              How many tags are we talking about here?  You could dump all of the data and use the UFL if it isn't a lot of points you need to fill.

                • Re: repairing missing data in pi archive
                  KEVING1958

                  Can’t use UFL because the BLUE PI Server is separated physically from the RED PI Server, using this OWL Software Data Diode System.

                   

                  The BLUE PI Server has the Interfaces to the Control System to grab the data, and there is a short term archive on that BLUE PI Server.

                   

                  Then the Owl File Transfer System uses File Transfers to transfer the data over the Data Diode, which is just a Fiber-Optic Link from the BLUE PI

                   

                  Server to the RED PI Server.  The Files are reconstituted in the FileTransfer Directory in the RED PI Server, as they are sent across the Data Diode.

                   

                  On the BLUE Server, when you look at the Files being Transmitted on the FileTransfer, we have PIOVATION Tags from our Ovation DCS Control

                   

                  System.  When you look at this FileTransfer directory you will see Time-Stamped Files show up and quickly disappear as they are transmitted to the

                   

                  RED PI Server.  If you are quick, you may even be able to double click on the files as they come and go and read them.  They are all time stamped,

                   

                  For example, 20180626030439.70.dat is one file that was transmitted.

                   

                  Then, when you go to the RED PI Server, these files show up there as well.  However on the RED PI Server end, as these files come in, they are still .dat files.  They then get processed and are converted to .999 files.  Then looking in the PI SMT Archive Editor you can see this data’s time slice being added to the Archive.  So all the files in the FileTransfer directory that have the .999 extension have their

                   

                  After a set time, then the Files in the FileTransfer directory are all purged.  However, immediately when the .dat files are processed to .999 files, the Archive Editor shows that there are archived values for that point.

                   

                  We tried yesterday to stop the Owl File Transfer service and RENAME all the points with .999 extensions back to .dat extensions.  These did not work like we thought when we tried to do so many.  We are trying to pursue other avenues today.

                   

                   

                   

                  Kevin M. Gardner

                  Kevin M. Gardner Engineering Services, LLC

                  kevin.gardner@lightstonegen.com

                  Working for Waterford Power LLC

                  201 Righteous Ridge Road

                  Waterford, Ohio 45786

                  Phone:  Office: (740)-984-3405

                                 Cell: (740)-568-8386

                              Home: (740)-678-8395

                  • Re: repairing missing data in pi archive
                    KEVING1958

                    We are talking about 9700 PI Tags on the BLUE PI Server, freezing the data for over 2 days…..

                     

                    Kevin M. Gardner

                    Kevin M. Gardner Engineering Services, LLC

                    kevin.gardner@lightstonegen.com

                    Working for Waterford Power LLC

                    201 Righteous Ridge Road

                    Waterford, Ohio 45786

                    Phone:  Office: (740)-984-3405

                                   Cell: (740)-568-8386

                                Home: (740)-678-8395

                  • Re: repairing missing data in pi archive
                    Sidh

                    Hi Kevin,

                     

                    There is one more option if you can copy the archive from BLUE server to RED i.e. Merging archive which will recover the missing data only thing you have to build a pointID conversion file.

                    I see this method as fastest if big count is involve.

                      • Re: repairing missing data in pi archive
                        KEVING1958

                        So what does the conversion file do, take the BLUE PI Server Tag Type, Tag ID and Record Number, then compare it to the RED PI Server to make sure that data goes to the right place?

                         

                        I think I am working toward that with OSI support.  We have the tags we need from the BLUE server sorted by Point Source and Record Number and the same for the RED Server and are working toward that conversion file.

                         

                        In hindsight, when creating tags in the BLUE Pi server, we should be creating tags with the same RECORD Number in the RED PI Server.

                        We presently do not do that.

                         

                        Kevin M. Gardner

                        Kevin M. Gardner Engineering Services, LLC

                        kevin.gardner@lightstonegen.com

                        Working for Waterford Power LLC

                        201 Righteous Ridge Road

                        Waterford, Ohio 45786

                        Phone:  Office: (740)-984-3405

                                       Cell: (740)-568-8386

                                    Home: (740)-678-8395