Blog Post

Introduction

What is the Staging Area?

You can stage batches of incoming source entities to preview the effect of batch submissions. This is a useful technique for testing purposes and data steward validation.

When you stage a batch, it is processed in virtually the same manner as an ordinary batch, but the source entities are not incorporated into the target domain or quarantined. You therefore have the opportunity to view the results that would have occurred had the batch actually been submitted, and you do not incur the risk of incorporating unwanted data into the domain or propagating that data to other source systems. Take advantage of this capability to reduce the uncertainty associated with the incorporation of new source systems, atypical data and source system schema changes into your Master Data Hub projects.

Prerequisites of using Staging Area:

1. Create a Repository.
2. Create a source.
3. Create a model.
4. Attach the source with the model and add some data quality steps.
5. After configuring the model Publish and Deploy it to the Repository.

Below is the configuration of my Model:

Fields:

Sources:

Data Quality Step:

Match Rules:

Now we need to create and add the staging area to a particular source, in order to do that we need to follow these steps:

Step 1. Go to your repository

Step 2. Click on your Model, click on the sources tab, and the Gear button beside the source for which you want to add a staging area.

Step 3. Select Add a Staging Area.

Step 4. Give a Staging Area name and ID, and click on Save.

Step 5. The staging area(Emp_Stage) will be added and displayed like this.

Configuration from the Hub side is completed, now we have to develop an integration process to upsert the records into the model.

Steps:

Step 1. Go to platform.boomi.com

Step 2. Login by giving your valid credentials (Username and Password).

Step 3. Home page will be displayed, now click on “Integration”.

Step 4. Click on the “Create New” button.

Step 5. Select “Process” and click on “Create”.

Step 6. Click on “No Data” option and click on “OK”.

Step 7. Drag and drop a Message shape.

Enter this message into the Message section:

empid, empname, phone

101, Apurba, 8975325167

Step 8. Add a Boomi Master data Hub connector. To configure the connection click on the “+” icon.

Step 9. Give the URL, UserName, and Token.

URL: Go to Atom Management à Click on “Test” atom cloud à Click on Shared web server à Copy the Base URL à Add “/mdm/” at the end.

Username and Token: Go to MDH à Select the Test repository à Configure Tab à Copy the Username and Auth token.

Step 10. Save and close, select the Action as Upsert, and then configure the operation.

Step 11. Click on Import operation.

Step 12. Select your Atom, give the Source name and Staging Area ID, and click on “Next”.

Step 13. Select your Model and click on Next.

Step 14. Click on Finish.

Step 15. Drag and drop one Mape shape and inside map component add two profiles. In the source side add the Employee profile and in the Target add the MDH upsert request profile.

After mapping each field click on Save and close.

Step 16. Add a stop shape at the end. The process should look like this now-

Step 17. Save the process and test.

Once the process got successfully executed, go to the MDH to check if our Staging Area is working properly.

Step 18. Go to Master Data Hub, click on Stewardship and select Staged Entities.

As we can see the records which we tried to upsert is added to this Staged Entities. Now we can decide what action should we take for this record.

We can Resubmit or Delete or Commit.

Delete: It will permanently delete the record.

Resubmit: It helps us to send the record to go through all the Data Quality steps and Match rules.

Commit: It helps us to move the record to the Golden Records.