org.apache.ambari.server.scheduler

Class ExecutionScheduleManager

java.lang.Object

org.apache.ambari.server.scheduler.ExecutionScheduleManager

public class ExecutionScheduleManager
extends Object

This class handles scheduling request execution for managed clusters

Field Summary

Fields

Modifier and Type	Field and Description
protected com.sun.jersey.api.client.Client	ambariClient
protected com.sun.jersey.api.client.WebResource	ambariWebResource
protected static String	BATCH_REQUEST_JOB_PREFIX
protected static Pattern	CONTAINS_API_VERSION_PATTERN
protected static String	DEFAULT_API_PATH
protected static String	REQUEST_EXECUTION_TRIGGER_PREFIX
protected static String	REQUESTS_ABORTED_TASKS_KEY
protected static String	REQUESTS_FAILED_TASKS_KEY
protected static String	REQUESTS_ID_KEY
protected static String	REQUESTS_STATUS_KEY
protected static String	REQUESTS_TIMEDOUT_TASKS_KEY
protected static String	REQUESTS_TOTAL_TASKS_KEY
static String	USER_ID_HEADER

Constructor Summary

Constructors

Constructor and Description
ExecutionScheduleManager(Configuration configuration, ExecutionScheduler executionScheduler, InternalTokenStorage tokenStorage, Clusters clusters, ActionDBAccessor actionDBAccessor, com.google.gson.Gson gson)

Method Summary

Modifier and Type	Method and Description
protected RequestStatus	abortRequestById(RequestExecution requestExecution, Long requestId)
protected void	buildApiClient()
boolean	continueOnMisfire(org.quartz.JobExecutionContext jobExecutionContext) Find out by how much did a schedule misfire and decide whether to continue based on configuration
void	deleteAllJobs(RequestExecution requestExecution) Delete all jobs and triggers if possible.
void	deleteJobs(RequestExecution requestExecution, Long startingBatchOrderId) Delete all jobs and triggers if possible.
Long	executeBatchRequest(long executionId, long batchId, String clusterName) Execute a Batch request and return request id if the server responds with a request id for long running operations.
protected com.sun.jersey.api.client.WebResource	extendApiResource(com.sun.jersey.api.client.WebResource webResource, String relativeUri) Returns the absolute web resource with DEFAULT_API_PATH
void	finalizeBatch(long executionId, String clusterName) Marks Request Schedule as COMPLETED, if: No triggers exist for the first job in the chain OR If the trigger will never fire again.
BatchRequestResponse	getBatchRequestResponse(Long requestId, String clusterName) Get status of a long running operation
String	getBatchRequestStatus(Long executionId, String clusterName)
protected String	getJobName(Long executionId, Long orderId)
boolean	hasToleranceThresholdExceeded(Long executionId, String clusterName, Map<String,Integer> taskCounts) Check if the allowed threshold for failed tasks has exceeded.
boolean	isSchedulerAvailable() Is Execution scheduler available for accepting jobs?
void	pauseAfterBatchIfNeeded(long executionId, long batchId, String clusterName) Checks if scheduled request should be auto paused and updates the status to PAUSED if it does.
protected BatchRequestResponse	performApiGetRequest(String relativeUri, boolean queryAllFields)
protected BatchRequestResponse	performApiRequest(String relativeUri, String body, String method, Integer userId)
protected BatchRequestResponse	performUriRequest(String url, String body, String method)
void	scheduleAllBatches(RequestExecution requestExecution) Persist jobs based on the request batch and create trigger for the first job
void	scheduleBatch(RequestExecution requestExecution, long startingBatchOrderId) Persist jobs based on the request batches staring from the defined batch and create trigger for the first job
void	scheduleJob(org.quartz.Trigger trigger) Add trigger for a job to the scheduler
void	start() Start Execution scheduler
void	stop() Stop execution scheduler
void	updateBatchRequest(long executionId, long batchId, String clusterName, BatchRequestResponse batchRequestResponse, boolean statusOnly)
void	updateBatchSchedule(RequestExecution requestExecution) Pause/resume/abort request schedule and related jobs and triggers
void	validateSchedule(Schedule schedule) Validate if schedule expression is a valid Cron schedule

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

BATCH_REQUEST_JOB_PREFIX

protected static final String BATCH_REQUEST_JOB_PREFIX

See Also:

Constant Field Values

REQUEST_EXECUTION_TRIGGER_PREFIX

protected static final String REQUEST_EXECUTION_TRIGGER_PREFIX

See Also:

Constant Field Values

DEFAULT_API_PATH

protected static final String DEFAULT_API_PATH

See Also:

Constant Field Values

USER_ID_HEADER

public static final String USER_ID_HEADER

See Also:

Constant Field Values

ambariClient

protected com.sun.jersey.api.client.Client ambariClient

ambariWebResource

protected com.sun.jersey.api.client.WebResource ambariWebResource

REQUESTS_STATUS_KEY

protected static final String REQUESTS_STATUS_KEY

See Also:

Constant Field Values

REQUESTS_ID_KEY

protected static final String REQUESTS_ID_KEY

See Also:

Constant Field Values

REQUESTS_FAILED_TASKS_KEY

protected static final String REQUESTS_FAILED_TASKS_KEY

See Also:

Constant Field Values

REQUESTS_ABORTED_TASKS_KEY

protected static final String REQUESTS_ABORTED_TASKS_KEY

See Also:

Constant Field Values

REQUESTS_TIMEDOUT_TASKS_KEY

protected static final String REQUESTS_TIMEDOUT_TASKS_KEY

See Also:

Constant Field Values

REQUESTS_TOTAL_TASKS_KEY

protected static final String REQUESTS_TOTAL_TASKS_KEY

See Also:

Constant Field Values

CONTAINS_API_VERSION_PATTERN

protected static final Pattern CONTAINS_API_VERSION_PATTERN

Constructor Detail

ExecutionScheduleManager

@Inject
public ExecutionScheduleManager(Configuration configuration,
                                        ExecutionScheduler executionScheduler,
                                        InternalTokenStorage tokenStorage,
                                        Clusters clusters,
                                        ActionDBAccessor actionDBAccessor,
                                        com.google.gson.Gson gson)

Method Detail

buildApiClient

protected void buildApiClient()
                       throws NoSuchAlgorithmException,
                              KeyManagementException

Throws:

NoSuchAlgorithmException

KeyManagementException

start

public void start()

Start Execution scheduler

stop

public void stop()

Stop execution scheduler

isSchedulerAvailable

public boolean isSchedulerAvailable()

Is Execution scheduler available for accepting jobs?

Returns:

scheduleJob

public void scheduleJob(org.quartz.Trigger trigger)

Add trigger for a job to the scheduler

Parameters:

trigger -

continueOnMisfire

public boolean continueOnMisfire(org.quartz.JobExecutionContext jobExecutionContext)

Find out by how much did a schedule misfire and decide whether to continue based on configuration

Parameters:

jobExecutionContext -

Returns:

scheduleAllBatches

public void scheduleAllBatches(RequestExecution requestExecution)
                        throws org.apache.ambari.server.AmbariException

Persist jobs based on the request batch and create trigger for the first job

Parameters:

requestExecution -

Throws:

org.apache.ambari.server.AmbariException

scheduleBatch

public void scheduleBatch(RequestExecution requestExecution,
                          long startingBatchOrderId)
                   throws org.apache.ambari.server.AmbariException

Persist jobs based on the request batches staring from the defined batch and create trigger for the first job

Parameters:

requestExecution -

Throws:

org.apache.ambari.server.AmbariException

getJobName

protected String getJobName(Long executionId,
                            Long orderId)

updateBatchSchedule

public void updateBatchSchedule(RequestExecution requestExecution)
                         throws org.apache.ambari.server.AmbariException

Pause/resume/abort request schedule and related jobs and triggers

Parameters:

requestExecution -

Throws:

org.apache.ambari.server.AmbariException

validateSchedule

public void validateSchedule(Schedule schedule)
                      throws org.apache.ambari.server.AmbariException

Validate if schedule expression is a valid Cron schedule

Parameters:

schedule -

Throws:

org.apache.ambari.server.AmbariException

deleteAllJobs

public void deleteAllJobs(RequestExecution requestExecution)
                   throws org.apache.ambari.server.AmbariException

Delete all jobs and triggers if possible.

Throws:

org.apache.ambari.server.AmbariException

deleteJobs

public void deleteJobs(RequestExecution requestExecution,
                       Long startingBatchOrderId)
                throws org.apache.ambari.server.AmbariException

Delete all jobs and triggers if possible.

Throws:

org.apache.ambari.server.AmbariException

executeBatchRequest

public Long executeBatchRequest(long executionId,
                                long batchId,
                                String clusterName)
                         throws org.apache.ambari.server.AmbariException

Execute a Batch request and return request id if the server responds with a request id for long running operations.

Returns:

request id

Throws:

org.apache.ambari.server.AmbariException

getBatchRequestResponse

public BatchRequestResponse getBatchRequestResponse(Long requestId,
                                                    String clusterName)
                                             throws org.apache.ambari.server.AmbariException

Get status of a long running operation

Returns:

Throws:

org.apache.ambari.server.AmbariException

abortRequestById

protected RequestStatus abortRequestById(RequestExecution requestExecution,
                                         Long requestId)
                                  throws org.apache.ambari.server.AmbariException

Throws:

org.apache.ambari.server.AmbariException

getBatchRequestStatus

public String getBatchRequestStatus(Long executionId,
                                    String clusterName)
                             throws org.apache.ambari.server.AmbariException

Throws:

org.apache.ambari.server.AmbariException

updateBatchRequest

public void updateBatchRequest(long executionId,
                               long batchId,
                               String clusterName,
                               BatchRequestResponse batchRequestResponse,
                               boolean statusOnly)
                        throws org.apache.ambari.server.AmbariException

Throws:

org.apache.ambari.server.AmbariException

performUriRequest

protected BatchRequestResponse performUriRequest(String url,
                                                 String body,
                                                 String method)

performApiGetRequest

protected BatchRequestResponse performApiGetRequest(String relativeUri,
                                                    boolean queryAllFields)

performApiRequest

protected BatchRequestResponse performApiRequest(String relativeUri,
                                                 String body,
                                                 String method,
                                                 Integer userId)

hasToleranceThresholdExceeded

public boolean hasToleranceThresholdExceeded(Long executionId,
                                             String clusterName,
                                             Map<String,Integer> taskCounts)
                                      throws org.apache.ambari.server.AmbariException

Check if the allowed threshold for failed tasks has exceeded. This needs to be an absolute value of tasks.

Parameters:

executionId -

clusterName -

taskCounts -

Returns:

Throws:

org.apache.ambari.server.AmbariException

finalizeBatch

public void finalizeBatch(long executionId,
                          String clusterName)
                   throws org.apache.ambari.server.AmbariException

Marks Request Schedule as COMPLETED, if: No triggers exist for the first job in the chain OR If the trigger will never fire again.

Parameters:

executionId -

clusterName -

Throws:

org.apache.ambari.server.AmbariException

extendApiResource

protected com.sun.jersey.api.client.WebResource extendApiResource(com.sun.jersey.api.client.WebResource webResource,
                                                                  String relativeUri)

Returns the absolute web resource with DEFAULT_API_PATH

Parameters:

webResource - Ambari WebResource as provided by the client ambariWebResource

relativeUri - relative request URI

Returns:

Extended WebResource

pauseAfterBatchIfNeeded

public void pauseAfterBatchIfNeeded(long executionId,
                                    long batchId,
                                    String clusterName)
                             throws org.apache.ambari.server.AmbariException

Checks if scheduled request should be auto paused and updates the status to PAUSED if it does. For now the condition is following: the current status is SCHEDULED, it's the first batch and the pauseAfterFirstBatch flag is TRUE

Throws:

org.apache.ambari.server.AmbariException