Configuration to allow an Integration Flow developed with ACE Toolkit to connect to Event Streams

Configuration to allow an Integration Flow developed with ACE Toolkit to connect to Event Streams

• Lab Overview
• Prerequisites
• Lab Environment
• 0 - Preparation
• 1 - Create a Topic in Event Streams
• 2 - Create SCRAM credentials to connect to Event Streams
• 3 - Create Resources in the ACE Toolkit
• 4 - Create Configurations in ACE Dashboard
• 5 - Deploy BAR file using ACE Dashboard
• Summary

Lab Overview

• Creating and Configuring an EventStreams Topic
• Configure App Connect Enterprise message flow using App Connect Enterprise toolkit
• Configuring App Connect Enterprise service
• Deploying App Connect BAR file on App Connect Enterprise Server
• Testing App Connect Enterprise API sending a message to EventStreams

Prerequisites

• You need to have an OpenShift environment with CP4I. For this session, your proctor will provide you a pre-installed environment, with admin access (more details below). If you want to create your personal environment, you can request an environment on IBM TechZone.
• You should have an Event Stream runtime pre-created in your CP4I on ROKS environment.
• You need to have the IBM App Connect Enterprise Toolkit installed in your desktop. Follow the sections Download IBM App Connect Enterprise for Developers and Install IBM App Connect Enterprise from this tutorial to install it.

Lab Environment

0 - Preparation

1. Log in IBM Cloud.

2. In IBM Cloud dashboard, change your IBM Cloud account to 2543884 - itztsglenablement05.

3. Now, click here to open the Team Environments page.

4. Click to go to the End-to-End Labs - Team Environments.

5. Open your Team’s section (A) (check the number of your team with the Lab’s proctors). Then, open your team’s Cluster page (B).

6. On your cluster’s page, click OpenShift web console.

7. Great, now let’s check your Cloud Pak for Integration environment. First we need to get the Platform Navigator URL and password. Let’s do it! Back to the OpenShift Web Console, open Workloads (A) and Secrets (B) again.

8. Now filter by cp4i project (A) and open the ibm-iam-bindinfo-platform-auth-idp-credentials secret (B).

9. Scroll down and click to copy the admin_password. You are welcome to take note of this password.

10. Now, let’s get the Platform Navigator URL. Open Networking (A) and Routes (B).

11. Scroll down and click on the cp4i-navigator-pn location to open the Platform Navigator.

12. If necessary, accept all the risks, and click IBM provided credentials (admin only) link.

13. Log in with admin user and the password that you copied in the previous step.

14. Close the Welcome dialog. Great, now you are ready for the lab. Enjoy it!

1 - Create a Topic in Event Streams

1. Navigate to the Event Streams instance from the CP4I Platform Navigator. Click on es-demo.

2. From the Event Streams Home page click on the Create a topic tile.

3. The wizard will guide you during the process. In the first screen type the topic name. In my case I have used kafka-cp4i-demo-topic. You can use any name, you will use it later on when cofniguring your Flow in the Toolkit.

4. You can review the different options, but for simplicity I’m accepting the defaults, so you can simply click Next.

5. You can change the retention period, but I’m accepting the default clicking Next without manking any change.

6. Click Create Topic to complete the wizard.

7. The new topic will be displayed in the Topics page. First confirm the topic was created and then return to the home page clicking on the Home icon.

2 - Create SCRAM credentials to connect to Event Streams

1. From the Event Streams Home page click on the Connect to the cluster tile.

2. The wizard will guide you duirng the process. First, make sure you have selected External. Then, copy the bootstrap information and paste it in a safe place since we will need it later on. Finally, click on Generate SCRAM credentials.

3. In the pop up window type the name of the user you want to create. In my case I have used ace-es-user-scram. Then click Next.

4. I will grant full access to the new user, but you can control the level of acces as needed. Once you adjust the values click Next.

5. Adjust the values as needed and click Next.

6. Select All transactional IDs or the value you prefer and then clik Generate credentials.

7. After a moment the credentials are generated and presented to you. Make sure to copy the password and paste it into a notepad since we will use it later.

8. Scroll down to the *Certificates section and click on Download certificate.

9. Navigate to the folder where you want to save the certificate and then click Save.

10. Once the certifcate is saved the corresponding password will be displayed. Click on the *Copy icon to paste it into a notepad for future use.

11. Scroll up and close the wizard.

12. Before we move to ACE we will need to convert the certificate format from PKCS12 to JKS. Open a Terminal and navigate to the location where you stored the certificate in step 8 and run the following command changing the cert-password value for the actual password you got in setp 10.

keytool -importkeystore -srckeystore es-cert.p12 -srcstoretype PKCS12 -destkeystore es-cert.jks  -deststoretype JKS -srcstorepass <cert-password> -deststorepass <cert-password> -srcalias ca.crt -destalias ca.crt -noprompt
Copy to clipboardCopied!

3 - Create Resources in the ACE Toolkit

1. From the Application Development pane click on *New and select Policy Project.

2. In the pop-up window enter the name of the project, i.e. CP4IESDEMOSCRAM and click Finish.

3. The project appears in the Application Development pane. Expand the project and click (New…). Then select Policy from the New Artifact menu.

4. In the pop-up window enter the name of the policy, i.e. es-demo and click Finish.

5. The *Policy Editor opens to enter the data. Click on the Type drop down box and select Kafka.

6. Update the policy using the following values:

7. Don’t forget to Save your changes.

8. Go back to the *Flow Editor to update the flow. Select the KafkaProducer node and update the properties in the Basic tab. Use the following information as a reference:

9. Select the Policy tab and in the window click Browse. From the pop-up window select the policty we just created and click OK.

10. The policy with be displayed in the *Policy field. Save your project to get rid of the error message.

11. Now we will create the BAR file to deploy our flow. Navigate to the *File menu and select *New and then BAR file

12. In the pop-up window enter the name of the BAR file, i.e. jgr-cp4i-esapi-scram and click Finish.

13. The BAR Editor is open. Select Applications, shared libraries, services, REST APIs, and Test Projects to display the right type of resources and then select your application, in this case JGRESAPISCRAM. Finally click Build and Save… to create the BAR file.

14. You can dismiss the notification window reporting the result clicking OK.

15. Before we head to the ACE Dashboard we need to do a final step. We need to create a zip file from the Policy Project we created earlier in this section. For that you need to navigate to the folder where your ACE Toolkit workspace is located (in my case that use Mac it is located at /Users/<your user>/IBM/ACET12/<you workspace>) and use your tool of choice to compress the folder where the policy project is located. The following picture shows a possible option.

16. Take a note where the zip file is located because we will use it in the next section.

4 - Create Configurations in ACE Dashboard

1. Back to CP4I Platform Navigator, open the ACE Dashboard.

2. Click on the Wrench icon to navigate to the Configuration section.

3. Once you are in the Configuration window, click on *Create configuration.

4. In the wizard click on the Type drop down box to select Truststore to upload the Event Streams certificate.

5. In the next window enter the name of the certificate you created in the previous section (es-cert.jks), then a brief description if you want to. In my case I used es-demo JKS certificate. Finally click on Drag and drop a single file here or click to import.

6. Navigate to the folder where you craeted the JKS certificate in the previous section and select the file and click Open.

7. Finally click Create to add the TrustStore Configuration.

8. Now we will define the Configuration to store the credentials selecting the setdbparms.txt type from the drop down box.

9. In the next window enter the name of the configuration. In my case I used cp4i-esdemo-scram-credentials. Followed by a brief description i.e. Credential to connect to es-demo using SCRAM. Finally use the following information as a reference to enter the data in the text box.

10. Now we will create the Configuration for the Policy selecting the Policy project type from the drop down box.

11. In the next window enter the name of the configuration, i.e *jgr-es-demo-scram-policy, a brief description if you want to, i.e. Policy to connect to Event Streams instance es-demo using SCRAM and finally click on hyper link Drag and drop a single file here or click to import to import the zip file we created in the previous section.

12. Navigate to the folder where you saved the zip file in the previous section, select the file and click Open.

13. Finally click Create to save the configuration for the policy project.

5 - Deploy BAR file using ACE Dashboard

1. From the ACE Dashboard home page navigate to the BAR files section clicking the Document icon and then click Import BAR + button.

2. In the wizard click the hyperlink Drag and drop a BAR file or click to upload to upload the BAR file we created in the previous section.

3. Navigate to the folder where the BAR file was created (nn Mac you can find it at /Users/<your user>/IBM/ACET12/<your workspace>/BARfiles) and select the file and click Open.

4. To complete the process click Import.

5. After a moment the file will be displayed in the list of BAR files available with the status of Not deployed

6. Now navigate to the Dashboard section and click on the Create server + button.

7. This will start the deployment wizard. Select the Medium Integration tile and then click the Next button.

8. In the next window click on the drop down box to select the BAR file we previuosly uploaded and then click Next.

9. In the next window select the 3 configurations we created in the previous section and then click Next.

10. In the next page give your deployment a name, i.e jgr-es-api-scram and open the YAML EDITOR.

11. Because of a known issue in Integration Server v12.0.5 with Kafka Nodes, we will use a previous version of the Integration Server. Let’s do it!

    Change the license value to L-APEH-C9NCK6 (A). And change the version value to 12.0.4.0-r2 (B). Then click Create (C).

12. After a moment you will be taken back to the Dashboard page where you will see a new tile with your Integration Server deployment name in Pending state, similar to the picture shown below:

13. The App Connect Dashboard is deploying the Integration Server in the background creating the corresponding pod in the specificed namespace of the Red Hat OpenShift Container Platform. This process can take more than a minute depending on your environment. Click the refresh button in your browser until you see the tile corresponding to your deployment in Ready state as shown below:

14. The next window shows the API in started state. Click on the tile to get the detaisl.

15. In the next page navigate to the operation implemented in your flow (POST /contacts). Then click on the Try it tab followed by the Generate hyperlink to generate some test data. Review the data generated and click the Send button.

16. After a moment you will get a response back. If everything is OK you will receive a 200 response code indicating the request was successful and the same payload you sent plus some metadata including a timestamp showing the request completed few seconds ago.

17. To fully confirm the message landed on the corresponding topic, you can navigate to the Event Streams instance and check the message is there. Once you are in the Event Streams Home page click on the Topics incon in the navigation section and then click on the topic you used in your flow. In my case kafka-cp4i-demo-topic.

18. In the topic page navigate to the Messages tab, then select the most recent message and confirm the payload includes the same data we sent during the test.

Summary

• Create and Configure an EventStreams Topic
• Configure App Connect Enterprise message flow using App Connect Enterprise toolkit
• Configure App Connect Enterprise service
• Deploy App Connect BAR file on App Connect Enterprise Server
• Test App Connect Enterprise API sending a message to EventStreams