SQLStreamBuilder Job Management

Every time you execute SQL, it becomes a job. It runs on the deployment as an Apache Flink job. You can manage running them using the jobs tab.

jobs

Monitoring a job

  • Click on SQLStreamBuilder on the side menu.
  • Click on the SQL Jobs tab.
  • Select the job you would like to monitor.
  • Select the Log or Performance tab on the bottom pane.

The Logs tab shows detailed logging from the Flink job itself - any exceptions will be logged here. As the job processes messages, a count of messages processed is spooled to the log every 5 seconds:

8/13/2019, 9:42:49 AM - INFO - 2019-08-08 19:24:17.752157 : 5 Second Count: 2502

The Performance tab shows a basic performance graph based on this data.

Stopping a job

  • Click on SQLStreamBuilder on the side menu.
  • Click on the SQL Jobs tab.
  • Click on the red stop button for the job you would like to stop.

Restarting a job

  • Click on SQLStreamBuilder on the side menu.
  • Click on the SQL Jobs tab.
  • Click on the select box below the State column and select Cancelled or Failed to see stopped jobs.
  • Select the job you would like to restart.
  • Select the Details tab at the bottom.
  • Select the Edit Selected Job button - this will bring up the SQL window in Edit Mode.
  • Select Restart to restart the job.

Editing a job

Editing a job is similar to restarting a job.

  • Click on SQLStreamBuilder on the side menu.
  • Click on the SQL Jobs tab.
  • Select the job you would like to edit.
  • Select the Details tab at the bottom.
  • Select the Edit Selected Job button - this will bring up the SQL window in Edit Mode.
  • Edit/alter the Target Deployment, Sink Virtual Table and the SQL itself as needed then select Restart to restart the job. The job will be stopped and restarted.

Sampling data for a running job

You can sample data from a running job. This is useful if you want to inspect the data to make sure the job is producing the results you expect. To sample the data from a running job:

  • Click on SQLStreamBuilder on the side menu.
  • Click on the SQL Jobs tab.
  • Select the job you would like to edit.
  • Select the Details tab at the bottom.
  • Select the Edit Selected Job button - this will bring up the SQL window in Edit Mode.
  • Click the Sample button. Results will be sampled and displayed in the results window. If there is no data meeting the SQL query, sampling will give up after a few tries.