shardedstagingpush

Staging Push transfers the responsibility of preparing a staging database to the end user. This ingestion method allows you to manually push the source data into the mount path backed by the Delphix Continuous Data Engine storage. It offers an alternative approach to the Staging pull model where the Delphix Continuous Data Engine takes care of preparing the dSource.

The Delphix appliance provides storage savings via combination of compression and storing new data by only writing file system blocks that are different from the current blocks. For Staging Push, Delphix operates, not at the file level, but file system level. Anything updating data on the filesystem would need to leave unchanged blocks untouched in the same place and apply updates by modifying or appending existing files. For this reason, it is recommended to choose a data synchronization method that leaves datafiles in place and only modifies or appends them.

If a data synchronization method is used which effectively recreate the datafiles, then even if the bulk of the data is unchanged, unless written to the exact same block offset on the filesystem (there is no way to guarantee that when creating new files), it is going to appear as new data to the Delphix appliance and data deduplication is going to be less effective and the results extremely variable in terms of storage impact.

Perform the following steps to create a dSource with the shardedstagingpush ingestion type.

Prerequisites

The source and staging instances must meet the host requirements as described in theRequirements for staging/target hosts section.

Procedure

1. Login to Delphix Management application.

2. Click Manage > Environments.

3. Click on Add dSource.

4. In the Add dSource dialog window, select the MongoDB source config created on the staging host.

5. Select the dSource type from the drop-down list in the dSource dialog window.

6. Enter the Mongo-specific parameters for your dSource configuration.

   • dSource Type: This is the type of dSource.

   • Source database details:

     • Source MongoDB Host Connect String: Connection string of the database to be created on the staging host.

     • MongoDB Source Database User: Database username of the database to be created.

     • MongoDB Password: Database password.

   • dSource (Sharded/Replica Set) details:

     • Staging MongoDB Host: This is the staging host for creating a dSource.

     • Mount Path: This is the mount path for dSource MongoDB instance data files.

     • bindIP String: The default value is 0.0.0.0.

     • Staging Port: This is the staging host port for MongoDB dSource instance. (Should be similar to the port mentioned in the Source MongoDB Host Connect String).

     • (Optional)Client Certificate for Mongos/Mongo session on Primary Node: This is the absolute path of client certificate to connect to staging database.

     • (Optional) Client CA Certificate for Mongos/Mongo session on Primary Node: This is the absolute path of root CA certificate that signed the client certificate.

   • Number of shards in staging database: This is the number of shards desired in the staging database.

   • Additional Nodes: Add all the additional host environments required in the staging database for staging database distribution.

   • Sharded dSource Details

     • Mongos Port Number: Enter the desired port number on which the mongos server would be running.

7. Click Submit to create a dSource.