ID#11754 - Oracle Integration 3 - Using OIC Native Actions to Harness…

… OCI Services (#66)

* pointed to correct md file

pointed to correct md file

* FBDI Import

FBDI Import

* Review of FBDI Import

Review of FBDI Import

* Title Change as per WMS title

Title Change as per WMS title

* Moved folder structure

Moved folder structure under ERP Cloud

* Bulk Extract and links modified in other labs

Bulk Extract and links modified in other labs

* Bulk extract

Bulk extract

* foldernamestolowercase

folder names to lowercase

* Update create-connections.md

* folder names

folder names

* Feedback by anoosha

Feedback by anoosha and implemented by Subhani

* Indent

Indent in all the workshops

* File2ObjectStorage

File moved to ObjectStorage

* review of core core-competencies

review of core core-competencies workshop as per latest release

* experiential review

experiential review

* updated on Jan 7th

Modified as per the latest version and also file references to the object storage

* Jan 9

Jan 9 as per the new UI

* BIP Report

BIP Report

* opa dp update

* DP Footer summary

* task 12 fixed instructions

* BIP report

BIP report and links in bulk extract

* Delete tracinglevel.png

* Update of objectstorage ref

Update of objectstorage ref

* Update bipreport.md

* Feb 6

Feb 6 update

* Feb 06

Feb 06

* Feb 07

Feb 07

* Atomfeed

Atomfeed

* Atomfeeds

Atomfeeds

* atomfeeds lab

atomfeeds lab

* Atomfeeds

Atomfeeds

* AtomFeed

AtomFeed Feb 16

* Update atomfeeds.md

* Feb 17th update

Feb 17th update

* Feb 17th update

Feb 17th update

* Feb 17th links

Feb 17th : video hub links update

* intro update

intro update

* Intro updated

Intro updated

* Update introduction.md

* File server update

File server update

* object storage link

object storage link updated

* hcm-cloud bulkimport lab

* intro section change

* title change

* intro changes

* title change

* code block changes

* code block fix

* escape characters fix

* escape character fix

* syntax fix

* review by Kishore

review by Kishore

* review

review by Subhani Mar 08

* QA By Kishore

* qa business services ll

* image fix business services ll

* BIP Report setup

BIP Report setup

* Update setup.md

* qa bulk extract

* Updates as suggested by LiveLabs QA

* qa directory sync

* qa get started. fixed oic3 provision path

* qa getstarted fixed file server path

* typo

review

* Minor spell check bulk import

* spell check

spell check

* exp lab prereqs

exp lab prereqs

* ERP extract ll. fixed Configure certificates md reference in manifest

* spell check

* Feedback

Feedback from Bootcamp and Ingrid and Lucy

* LL understand rest adapter-first branch commit

* minor update

* bucket changes

* image fix

* pr corrections

* pr rec changes

* lab fixes post ORDS version changes

* fixed the ords pl/sql code

* folder structure commit for cloud world usecase

* Updated as per the latest release

Updated as per the latest release

* OPA flow

OPA flow

* naming convention

naming convention

* Aug 02

Aug 02 modification, done until creating structured process.

* Aug 02

Aug 02 modification

* Aug 03 modifications

Aug 03 modifications

* Aug 04 modification

Aug 04 modification

* Aug 05

Aug 05

* Aug 05 changes

Aug 05 changes

* Aug 07 noon

Aug 07 noon

* final review

final review

* intro,getstarted,lab1,2,3,4 additions

* subhanis work opa commit

* Vijayas ODA changes

* connector url

connector url

* ODA peer review

ODA peer review

* Aug 09 peer review 8pm

Aug 09 peer review 8pm

* create oda

create oda

* oda and integrations fix

* section added:opa add app roles to users

* opa peer review KK

* peer review changes

peer review changes

* Peer review changes

Peer review changes

* architecture diagram added

* Peer review Aug 11

Peer review Aug 11

* Peer review Aug 11

Peer review Aug 11

* title change

* Integration style modification

Integration style modification

* Peer review

Peer review

* oda changes and image updates -KK

* Aug 12

Aug 12

* remove opa folder

remove opa folder

* Removed OIC Flow

Removed OIC Flow

* added opa and oic flows

added opa and oic flows

* duration

duration

* conclusion sections added to all labs

* link fixed

* fixed copy tags

* table properties updated

* image link and naming convention fixed

* image references fix

* image name ll qa compliance

* oda qa compliance fixes

* copy tag allignment fix

* copy text image allignment fix

* ocw folder addition for getting started oic 3

* ocw folder update and minor instruction fixes

* ocw folder update and instruction fix

* ocw update and additional info added

* minor change of po creation in erp cloud

* fixed xpath filter expression,cloud shell,lab sequence swaps to meet pre conf requirements

* critical changes per product updates

* changed the adw deployment type to serverless

* architecture ocw template

* Oct 03 changes

Oct 03 changes. by Subhani

* HCM Updates done

HCM Updates done

* Common modification

Common modification

* Oct 10

Oct 10 bulk extract, bip report and events

* Oct 11

Oct 11 updates

* Oct 11 changes

Oct 11 changes

* new LL hcm journeys booster opa

* added get started section

* minor edit

* added couple of tasks in get started section

* filename corrections

* PAR resources link

PAR resources link

* oic3 b2b structure commit

* B2B Outbound

B2B Outbound by Subhani

* Update of outbound

Update of outbound

* b2b outbound

b2b outbound

* Inbound started

Inbound started

* Inbound update

Inbound update

* Inbound update

Inbound update

* Updates

Updates of the links

* Feb 16

Feb 16 changes

* Formatting

Formatting

* Format modification

Format modification

* Feb 20 update

Feb 20 update

* Update b2b-trading-partner-manager.md

* get started hc lab

* underscore issues

* from subhani

Outbound and inbound labs

* lab numbering fixed

* title fix

* updates

* added images with rename

* review changes by livelabs team

review changes by livelabs team

* Delete switchAction.png

* b2b file path modification

b2b file path modification

* b2b file path modification

b2b file path modification

* rab ll commit

* lab artifacts par fixed

* added video link in intro

* petty formatting fixes

* peer review changes

* minor updates and typo fixes

* ocw 24 live lab

* updated db invoke changes

* contributor update

* last update change

* removed tbd video link

* fixed lab 6 task 6 indentation

* oic3 provision path fix

* oic provision copied to opa common

* features 2024

* updates on Aug 02

updates on Aug 02

* updates on Aug 03

updates on Aug 03

* architecture diagram

architecture diagram added

* architecture diagram added

architecture diagram added

* Modified in main branch

Modified in main branch

* as per the wms feedback

Updated as per the wms feedback

* old images deleted

* new images

new images added

* oic native actions publish

* final flow added

* estimated time updated

* few updates of labs

* index.html updated as per merge comments

---------

Co-authored-by: Subhani Sahib Italapuram <[email protected]>
Co-authored-by: Subhani Sahib Italapuram <[email protected]>
Co-authored-by: Ravi Chablani <[email protected]>
Co-authored-by: Hope Fisher <[email protected]>
Co-authored-by: Subhani Sahib Italapuram <[email protected]>

oic-gen3/features-2024/native-actions/create-function/create-function.md

@@ -0,0 +1,203 @@
+# Setup
+
+## Introduction
+
+This lab walks you through the pre requisite setup required to create a function application and deploy the function.
+
+Oracle Functions is a fully managed, highly scalable, on-demand, Functions-as-a-Service platform, built on enterprise-grade Oracle Cloud Infrastructure and powered by the Fn Project open source engine. Use Oracle Functions (sometimes abbreviated to just Functions) when you want to focus on writing code to meet business needs. You don't have to worry about the underlying infrastructure because Oracle Functions will ensure your app is highly-available, scalable, secure, and monitored. With Oracle Functions, you can deploy your code, call it directly or trigger it from OIC, and get billed only for the resources consumed during the function execution.
+
+
+Estimated Time: 45 minutes
+
+### Objectives
+In this lab, you will:
+- Setup Function prerequisites
+- Create a function application
+- Modify the boilerplate code generated function application using Python.
+- Deploy the function
+
+### Prerequisites
+This lab assumes you have:
+- Completed all the previous labs
+
+## Task 1: Create a function application
+
+1.  Sign in to the OCI Console as a functions developer.
+
+2.  Open the navigation menu, click *Developer Services*. Under **Functions**, click *Applications*
+
+3.  Select the region you're using with OCI Functions.
+
+4.  Select the same compartment (example: ll-native-actions) you have used to provision OIC instance in the previous lab. We will create the Function application in the same compartment.
+
+5.  Click *Create Application*
+
+6.  Specify:
+      - **oicnativeaction** as the name for the new application. You'll deploy your first function in this application, and specify this application when deploying/invoking the function.
+      - The VCN and subnet in which to run the function. Select the **public subnet** in the VCN **ll-native-actions-vcn** , and a **private subnet** in the same VCN.
+      - Leave the shape with defaults
+
+![Create Function Application](images/create-function-app.png)
+
+7.  Click **Create**
+
+## Task 2: Set up your Cloud Shell dev environment
+
+We will use OCI Cloud Shell environment to develop and deploy our function
+
+1.  Click the **oicnativeaction** function application you just created to display the application details page.
+
+2.  Click the *Getting Started* link, and then click *Cloud Shell Setup*. Duplicate a browser window to copy paste few commands in cloud shell as we follow through the next steps.
+
+![Get Started Page](images/function-app-cloudshell-select.png)
+
+**Tip:** The Getting Started page now displays commands tailored specifically for you. You copy and paste these commands to configure your Cloud Shell environment for functions development.
+
+![Functions All Commands Page](images/functions-all-commands-page.png)
+
+3.  Click *Launch Cloud Shell* to display the Cloud Shell terminal window. Make sure the Network is selected as public in the green banner.
+
+## Task 3: Set up Fn Project CLI context
+
+Copy and paste commands from the Getting Started page into the Cloud Shell terminal window to configure your environment, as follows:
+
+1.  Find the name of the pre-created Fn Project context for the current region in which you created the application:
+
+    ```
+    <copy>
+    fn list context
+    </copy>
+    ```
+    At least two Fn Project contexts are returned, a default context and a context for the current region (for example, named us-phoenix-1).
+
+2.  Set the Fn Project context to use the region context. where <region-context> is the context for the current region. For example:
+
+    ```
+    <copy>
+    fn use context <region-context>
+    </copy>
+    ```
+
+3.  Configure the Fn Project context with the OCID of the current compartment that will own deployed functions:
+
+    ```
+    <copy>
+    fn update context oracle.compartment-id <compartment-ocid>
+    </copy>
+    ```
+
+    The current context should be updated.
+
+4.  Configure the Fn Project context with the Oracle Cloud Infrastructure Registry address in the current region and tenancy that you want to use with OCI Functions. Provide a unique repository name suffix (for example: oic-native-actions-repo) to distinguish your function images
+
+    ```
+    <copy>
+    fn update context registry <region-key>.ocir.io/<tenancy-namespace>/<repo-name-prefix>
+    </copy>
+    ```
+    where <repo-name-prefix> for example: is a prefix of your choosing for the Oracle Cloud Infrastructure Registry repository in which to store images for the function
+
+5.  Configure the Fn Project context with the OCID of the compartment for repositories to and from which you want OCI Functions to push and pull function images, by entering:
+
+    ```
+    <copy>
+    fn update context oracle.image-compartment-id <compartment-ocid>
+    </copy>
+    ```
+    If you do not specify a value for oracle.image-compartment-id, OCI Functions pushes and pulls images to and from repositories in the root compartment.
+
+## Task 4: Generate Auth token
+
+In continuation to the above the next step is to generate auth token to login into registry
+
+1.  Click *Generate an Auth Token* to display the Auth Tokens page, and click **Generate Token**.
+
+2.  Enter a meaningful description for the auth token in the Generate Token dialog, and click *Generate Token*. The new auth token is displayed (for example, 6aN...6MqX).
+
+3.  Copy the auth token immediately to a secure location from where you can retrieve it later, because you won't see the auth token again in the Console.
+
+4.  Close the **Generate Token** dialog.
+
+## Task 5: Log in to Registry
+
+In continuation to the previous task the next step is to login to docker registry with the auth token generated. This step confirms that you have access and ready to register and deploy the function code.
+
+1.  Copy the following command. Modify the command as per your tenancy namespace, username and region key.
+
+    ```
+    <copy>
+    docker login -u '<tenancy-namespace>/<user-name>' <region-key>.ocir.io
+    </copy>
+    ```
+
+2.  When prompted for a password, enter the Oracle Cloud Infrastructure auth token that you created and copied earlier.
+    You should see login succeeded message. You're now ready to start creating, deploying, and invoking functions.
+
+3.  Execute the below to confirm function apps are listed
+
+    ```
+    <copy>
+        fn list apps
+    </copy>
+    ```
+
+    You should see function apps in the respective compartment displayed
+
+## Task 6: Create and Deploy your function
+
+In this section we will initialize function workspace which generates a boilerplate code in python. We will create our excel to csv function code in python. We will make some modifications as per the code in the artifact provided. [Download](https://objectstorage.us-phoenix-1.oraclecloud.com/p/SrKYt_S-_e5uWp_jo44A1sGMQwYnybC86-ZaQzHUbyKw5oRRKBG-wdN3sZHQHEFG/n/oicpm/b/oiclivelabs/o/oic3/oic-native-actions/native-actions.zip) lab artifacts to your desktop and unzip the file.
+
+1.  In the **Cloud Shell** command line execute the below commands to create a directory  and initialize the workspace.
+
+    ```
+    <copy>
+      mkdir functions
+      cd functions
+      fn init --runtime python convert2CSV
+      cd convert2CSV
+      ls
+    </copy>
+    ```
+    You should see 3 files func.py, func.yaml, requirments.txt files created.
+
+2.  From the developer tools at the top banner, open **Cloud Editor**.
+
+![Open Cloud Editor](images/open-cloud-shell.png)
+
+3.  Select **func.py** file. On th eright hand side code editor sample boilerplate code is available. Replace the entire code with code snippet in the downloaded artifacts (func.py file) and save.
+
+4.  Select the **requirements.txt** file. In the boilerplate code generated, replace the below snippet and save the code.
+
+    ```
+    <copy>
+    fdk>=0.1.36
+    oci
+    pandas
+    openpyxl
+    xlrd
+    </copy>
+    ```
+
+5.  Enter the following single Fn Project command to build the function and its dependencies as a Docker image called **convert2CSV**, push the image to the specified Docker registry, and deploy the function to OCI Functions in the **oicnativeaction** application that you created earlier:
+
+    ```
+    <copy>
+    fn -v deploy --app oicnativeaction
+    </copy>
+    ```
+Note: The function image build might take a bit because of some pre req py libraries.
+![Function Created](images/create-function-image-success.png)
+
+6.  Confirm that the function has been deployed to OCI Functions by clicking Functions (under Resources on the details page for the **oicnativeaction** application) and noting that the **convert2CSV** function now appears.
+
+![List Function In The App](images/list-function-in-app.png)
+
+You may now **proceed to the next lab**.
+
+## Learn More
+
+* [Setup Your Tenancy with Functions Pre-Requisites](https://docs.oracle.com/en-us/iaas/Content/Functions/Tasks/functionsquickstartcloudshell.htm)
+
+## Acknowledgements
+* **Author** - Kishore Katta, Director Product Management - Oracle Integration & OPA
+* **Last Updated By/Date** - Kishore Katta - August 2024

oic-gen3/features-2024/native-actions/functions-setup/functions-setup.md

@@ -0,0 +1,64 @@
+# Setup
+
+## Introduction
+
+This lab walks you through the pre requisite setup like creating VCN and policies required to access OCI resources to complete the workshop.
+
+Estimated Time: 45 minutes
+
+### Objectives
+In this lab, you will:
+- Create VCN and subnets
+- Create policy for group and service to create serverless functions
+
+### Prerequisites
+This lab assumes you have:
+- Ensure that your cloud tenancy uses identity domains. Invoking Oracle Cloud Infrastructure functions from an integration does not work in cloud tenancies that are not enabled for identity domains.
+- Completed all the previous labs
+- Created a group and added the required User to the group.
+
+
+## Task 1: Create VCN and subnets
+
+If a suitable VCN in which to create network resources doesn't exist already:
+
+1.  Sign in to the OCI Console as a tenancy administrator.
+
+2.  Open the navigation menu, click *Networking*, and then click *Virtual cloud networks*.
+
+3.  Select the same compartment (example: ll-native-actions) you have used to provision OIC instance in the previous lab. We will create the OCI resources in the same compartment.
+
+3.  Click *Start VCN Wizard* to create a new VCN.
+
+![Start VCN Wizard](images/start-vcn-wizard.png)
+
+4.  In the Start VCN Wizard dialog box, select **VCN with Internet Connectivity** and click *Start VCN Wizard*.
+
+5.  Enter a name for the new VCN (example: ll-native-actions-vcn), click *Next*, and then click *Create* to create the VCN along with the related network resources.
+
+![Start VCN Wizard Step 1](images/start-vcn-wizard-step1.png)
+
+6.  VCN is created with the all the resources such as Subnets, Route Tables, CIDR blocks, Internet Gateway, Security Lists, NAT Gateways, Service Gateways along with DHCP options
+
+![Start VCN Wizard Resources List](images/start-vcn-wizard-step2.png)
+
+## Task 2: Create policy for group and service
+
+1.  In the OCI Console, Open the navigation menu and click *Identity & Security*. Under Identity, click *Policies*.
+
+2.  Click Create *Policy*, specify a name (example: ll-native-actions-policy) and description for the new policy, and select the tenancy's root compartment.
+
+3.  Use the Policy Builder to create the policy. Select *Functions* from the list of Policy use cases, and base the policy on the policy template *Let users create, deploy, and manage functions and applications*. Select the **Identity Domain**, **Groups** , **Location** (example: ll-native-actions compartment)
+
+![Create Policy](images/create-policy.png)
+
+
+You may now **proceed to the next lab**.
+
+## Learn More
+
+* [Setup Your Tenancy with Functions Pre-Requisites](https://docs.oracle.com/en-us/iaas/Content/Functions/Tasks/functionsquickstartcloudshell.htm)
+
+## Acknowledgements
+* **Author** - Kishore Katta, Director Product Management - Oracle Integration & OPA
+* **Last Updated By/Date** - Kishore Katta - August 2024

oic-gen3/features-2024/native-actions/introduction/introduction.md

@@ -0,0 +1,84 @@
+# Introduction
+
+In today's fast-paced business environment, the ability to efficiently manage and process data is crucial for maintaining a competitive edge. For many organizations, including global retailers like GlobeShoppe Inc., data is generated and stored in various formats across different systems. To streamline operations and enable real-time decision-making, these organizations must integrate and process this data seamlessly.
+
+This workshop will guide you through an end-to-end integration flow using Oracle Integration (OIC) to automate the transfer, conversion, and processing of Excel files stored on a File server. By leveraging native actions in OIC to invoke Oracle Cloud Infrastructure (OCI) services, you can create a robust and scalable solution for your data integration needs.
+
+**Business Scenario:**
+
+Imagine GlobeShoppe Inc., a global retail company with regional offices that maintain daily records of inventory, sales, and shipments in Excel files. These files are stored on a centralized File server, making manual processing time-consuming and error-prone. To overcome these challenges, GlobeShoppe Inc. aims to automate the entire process, from transferring files to converting and processing them for real-time analytics and reporting.
+
+In this workshop, we will implement a seamless and automated integration flow using Oracle Integration Cloud (OIC) to transfer, convert, and process Excel files stored on an FTP server. Below is a detailed description of the functional flow for the integration steps:
+
+**Listing Files on the File Server:**
+  - The process begins with a scheduled orchestration in OIC that triggers at specified intervals.
+  - Using OIC’s native file server action, the orchestration lists all the Excel files available on the embedded File server.
+
+**Processing Files in Iteration:**
+  - For each file listed, OIC uses the file server native action to obtain a file reference.
+  - The file is then pushed to an OCI Object Storage bucket (named bucket-excel) using OIC’s native Object Storage action. This temporary storage serves as a staging area for the file conversion process.
+
+**Invoking the Excel-to-CSV Conversion Function:**
+  - Once the Excel file is stored in a bucket ex: bucket-excel, OIC invokes a serverless function hosted in Oracle Cloud Infrastructure (OCI).
+  - The function is responsible for converting the Excel file to CSV format. It processes both .xlsx and .xls files.
+  - After conversion, the function pushes the resulting CSV file to a target Object Storage bucket (named bucket-csv).
+
+**Reading and Staging the CSV File in OIC:**
+  - The final step involves OIC picking up the newly generated CSV file from bucket-csv.
+  - The CSV file is read and staged in OIC using the stage file action, preparing it for further data processing and integration tasks, such as updating a database or generating reports.
+
+## About this Workshop
+
+This hands-on workshop is designed to equip you with the knowledge and skills to automate data workflows by integrating Oracle Integration (OIC) with Oracle Cloud Infrastructure (OCI) services.
+
+In this workshop, you will learn how to:
+
+1.  Transfer Excel Files from an FTP Server to OCI Object Storage
+2.  Convert Excel Files to CSV Using an OCI Serverless Function
+3.  Process CSV Files in OIC
+
+Note: Inserting records into database is out of the scope of this workshop. However, feel free to play around with the transformed data and push it to the downstream systems.
+
+
+Here is the high level architecture reference of the workshop
+![Usecase Architecture](images/native-actions-hla.png)
+
+Estimated Time: 3 hours
+
+### Objectives
+
+Here are some high-level objectives for the workshop on Oracle Integration using native actions:
+
+1.  Understand OIC Native Actions
+    - Gain insights into the capabilities of OIC native actions and how they can be used to integrate with OCI services effectively
+2.  Automate File Transfer
+    - Learn how to configure OIC to list and download Excel files from a File server and upload them to OCI Object Storage
+3.  Implement Serverless Functions
+    - Deploy and use an OCI serverless function to convert Excel files to CSV format.
+4.  Process CSV Files in OIC
+    - Discover functions, how to pick up, stage, and finally process CSV files within OIC
+5.  Hands-on activities and exercises
+    - Provide hands-on exercises to practice usage of native actions to invoke file server, object storage and serverless functions.
+
+By the end of this workshop, you will have a comprehensive understanding of how to leverage OIC's native actions to invoke OCI services, creating a seamless and automated integration design.
+
+**High level workflow of the Workshop**
+
+![Usecase Workflow](images/uc-highlevel-workflow.png)
+
+### Prerequisites
+
+This lab assumes you have the following:
+* Oracle Cloud Account with credits to provision services.
+* Access to Oracle Cloud Infrastructure (OCI) with permissions to create and manage serverless functions and Object Storage buckets.
+
+You may now **proceed to the next lab**.
+
+## Learn More
+
+* [Oracle Integration 3 Documentation](https://docs.oracle.com/en/cloud/paas/application-integration/index.html)
+* [Oracle Integration 3 Native Actions](https://docs.oracle.com/en/cloud/paas/application-integration/integrations-user/add-actions-app-driven-orchestration-integration.html#GUID-63CCAB23-A32C-4655-9490-191A011E9EEA)
+
+## Acknowledgements
+* **Author** - Kishore Katta, Oracle Integration Product Management
+* **Last Updated By/Date** - Kishore Katta, August 2024