Enable SimpCon Pull Producer

overview this extension retrieves data from an external source system and publishes the data to a data streaming service topic the extension requires connection details for the source system, including the endpoint url and authentication credentials optional filters, such as assignment groups and domain separated company names, can be configured to limit the data processed by the extension the extension prevents unintended data reingestion after kubernetes restarts by using a stored date and time offset the extension compares the value of the dx env user start datetime environment variable with the current utc date and time during a user initiated start or restart, the stored value should be within one hour of the current utc time during an automatic kubernetes restart, the environment variable typically contains a previously cached start time that is more than one hour old the comparison helps prevent accidental reprocessing of data after an unexpected container restart the extension assumes that both the user start date and time and the current date and time use utc the one hour threshold might not be appropriate for all deployment environments and should be evaluated based on operational requirements chainguard migration starting with version 3 0 0, extensions created from this template use the simplified connectors framework running on a chainguard based tomcat image platform service interactions the extension transforms and forwards requests to the following data streaming service topic itil xxxxx source configure the extension the following environment variables must be provided to the container variable default comments dx env environment (string) the type of environment the extension is running in local, dev, or prod dx env pv mount (string) /var/lib/misc the path where the extension state (state properties) will be deployed on, always /var/lib/misc dx env ou key (string) ou tenant key dx env ou bac id (string) bac id of the client dx env ou es instance (string) the elasticearch instance the messages are supposed to go to on the consumer side dx ext cdi tool source (string) client tool mapping value dx ext cdi customercode (string) client tool mapping value dx ext source query url (string) smt url to query for ticket state dx ext source user (string) smt username used for basic authentication dx ext source pw (string) smt password used for basic authentication results from execution the extension retrieves data from servicenow and publishes the data to a data streaming service kafka topic because the extension processes data asynchronously, no application level response code is returned the extension processes messages in batches at intervals defined by the configured environment variables runs continuously as a containerized application uses kubernetes liveness and readiness probes to report runtime health status how the extension works this application is a simplified connector producer designed to run as an extension instance in the integrated platform the application runs as a container in kubernetes and follows a producer workflow that retrieves records from the source system and publishes them to a data streaming service topic deploy the extension the extension is intended for deployment and configuration through the integrated aiops user interface for a specific organizational unit (ou) or compute zone local execution is intended only for developers who are familiar with the extension codebase run the extension locally build the container image open a terminal session navigate to the extension directory cd \<extension path> build the docker image docker build t simpcon pull producer 1 0 0 f /deployment/dockerfile start the container run the container and provide the required environment variables docker run rm \\ \ network host \\ itd \\ p 8080 8080 \\ e dx env environment=local \\ e dx env pv mount=/var/lib/misc \\ e dx env ou key=098a759b1e7c 1 \\ e dx env ou bac id=bac0000bf2 \\ e dx env ou es instance=es was1 \\ e dx ext cdi tool source=snow extsvc \\ e dx ext cdi customercode=id1 \\ e dx ext source query url= https //dev service now\ com/api/now/table/incident https //dev service now\ com/api/now/table/incident \\ e dx ext source user=\<source username> \\ e dx ext source pw=\<source password> \\ simpcon producer 1 0 0 monitor the container view running containers docker ps view container logs docker logs \<container id> | less troubleshoot the container identify the container id docker ps open a shell session in the container docker exec it \<container id> /bin/bash support the extensions development team owns and maintains this extension