Introducing the all-new TIBCO Community site!

For current users, please click "Sign In" to reset your password and access the enhanced features. If you're a first-time visitor, we extend a warm welcome—click "Sign Up" to become a part of the TIBCO Community!

If you're seeking alternative community sites, explore ibi, Jaspersoft, and Spotfire.

Jump to content

Query Block: Method to get last run datetime of map


Manoj Chaurasia

Recommended Posts

You could take a different approach - if you use "something" as a query to step into your map, you could then use the Scribe API Connector to pull back the LastRunTime of the map you are currently in, and pass that into a Fetch Block as a filter parameter.

 

That should give you what you need with a slightly different pattern to get there.

 

Brendan

Link to comment
Share on other sites

  • 1 year later...

Hi Charles,

 

Could you elaborate more on your use case

 

- Netchange feature in scribe maps is one of many ways to retrieve deltas for an ETL batch run, other ways does include:

 

 

 

Depending on what system you are reading from and which connector your are using and the fields available to you:

 

- Implementing your own netchange or high water mark by persisting it in a lookup table somewhere in a database or file.

 

- By using Filter on a lastmodified field and using a scribe dateadd -15 m formula to only process the last 15 minutes of transactions for example and run this every 15 mins for example or on top of each hour for the last hour of transactions.

 

If the filter formula is not possible for any reason, you can add an If block in your map and filterout using different criterias and filtering rules in the If block (using AND or OR logic).

 

Other ways include using a webhook style integration to trigger changes(deltas to a scribe REST endpoint in a TCI Scribe or TCI Flogo endpoint) and to be processed one record at a time as the changes/events are triggered.

 

 

 

 

 

 

Link to comment
Share on other sites

×
×
  • Create New...