2 Replies Latest reply on Oct 31, 2018 6:15 AM by jyi

    PI (On-premises) to Cloud (Azure Datalake)


      Can some one share the knowledge on below,

      1) What are the ways to send data from PI (On-premises) to Cloud (Azure Datalake) , when only PI DA is used , without PI AF configured.

      2) If PI Integrator for Business Analytics 2018 (Advanced version) is used then -

      i) Will PI be able to send data to cloud continuously (on event based/value changes) ? or within time intervals ?

      ii) Is there a limitation on volume of PI data which can be sent using PI Integrator for Business Analytics 2018 (Advanced version)

      iii) How is the licensing done ?

      iv) Pros & cons of this mode of PI data transfer to cloud , compared with other conventional modes like PI-ODBC, PI web API etc.



      3) There is a  POC  using PI  - ODBC ,and for around 1500-2000 tags, it almost takes 15 min to extract and send it to cloud. What could be the reason of long PI data extraction time and how improvements can be brought in here.




        • Re: PI (On-premises) to Cloud (Azure Datalake)

          Hi Mukund


          Most of the integrators/connectors use AF and would also recommend the same.Based on your requirement I would suggest PI Business Analytics to Azure Target. Conventional methods you need to define your implementations and maintain the custom code. Creating asset views, publishing and scheduling is not available by default and you may need to depend on windows tasks or services. With PI BA you have all available by default. Regarding license it is tag based license i.e. how many tags and you can contact sales/techsupport team for exact details.


          KB01481 - Features of PI Integrator for Business Analytics


          1500-2000 tags taking more time to extract and transfer might me due to data. It depends on tag frequency rate (data collection rate) and if you using summary calculations like total, avg etc it will take more time than expected. If your achieve subsystem is busy then you will have performance impact.


          Please find the details in KB acticle above related to scheduling - trigger based and continuous.




          • Re: PI (On-premises) to Cloud (Azure Datalake)

            Hi Mukund,


            PI Integrator for Business Analytics requires AF contexts to your time series data. We believe that this is the only manageable way to deal with numerous asset data by keeping the metadata information in AF and let users access data through AF. AF provides that framework.

            Therefore I'm afraid that you will not be able to use PI Integrator for BA if you have no AF configured but I strongly recommend you to configure AF.

            Also, the data extracted by PI Integrator will be different from compressed-raw- data within your PI System. There will be an interpolation.


            To answer your questions,

            2 i ) PI Integrator to Azure Datalake target is based on a time interval. Only the supported targets can be streamed by Advanced edition ( Apache Kafka, Azure Iot Hub and EventHub)

            2 ii) No technical limitations as I am aware unless it's licensing.

            2 iii) Licensing is done via #streams to your target.

            2 iv) PI Integrator is a product (install, configure and use) meanwhile PI ODBC Driver, PI Web API are both member of PI Developer technologies. You have both more freedom and pitfalls with PI Developer Technologies. But you do have to come with your own ways to connect/send data to Azure datalake stores.


            Thank you Lal for the KB!