pulsar package¶
Subpackages¶
- pulsar.cache package
- pulsar.client package
- Subpackages
- pulsar.client.staging package
- pulsar.client.test package
- pulsar.client.transport package
- Submodules
- pulsar.client.action_mapper module
- pulsar.client.amqp_exchange module
- pulsar.client.amqp_exchange_factory module
- pulsar.client.client module
AwsBatchMessageCoexecutionJobClient
AwsBatchPollingCoexecutionJobClient
BaseJobClient
BaseMessageCoexecutionJobClient
BaseMessageJobClient
BasePollingCoexecutionJobClient
BaseRemoteConfiguredJobClient
ClientManagerProtocol
CoexecutionContainerCommand
CoexecutionLaunchMixin
ExecutionType
InputCachingJobClient
JobClient
K8sMessageCoexecutionJobClient
K8sPollingCoexecutionJobClient
LaunchesAwsBatchContainersMixin
LaunchesK8ContainersMixin
LaunchesTesContainersMixin
MessageCLIJobClient
MessageJobClient
MessagingClientManagerProtocol
OutputNotFoundException
TesMessageCoexecutionJobClient
TesPollingCoexecutionJobClient
tes_state_is_complete()
tes_state_to_pulsar_status()
- pulsar.client.config_util module
- pulsar.client.decorators module
- pulsar.client.destination module
- pulsar.client.exceptions module
- pulsar.client.job_directory module
RemoteJobDirectory
RemoteJobDirectory.calculate_path()
RemoteJobDirectory.configs_directory()
RemoteJobDirectory.default_tmp_directory()
RemoteJobDirectory.home_directory()
RemoteJobDirectory.inputs_directory()
RemoteJobDirectory.metadata_directory()
RemoteJobDirectory.outputs_directory()
RemoteJobDirectory.path
RemoteJobDirectory.separator
RemoteJobDirectory.tool_files_directory()
RemoteJobDirectory.unstructured_files_directory()
RemoteJobDirectory.working_directory()
get_mapped_file()
verify_is_in_directory()
- pulsar.client.manager module
- pulsar.client.object_client module
ObjectStoreClient
ObjectStoreClient.create()
ObjectStoreClient.delete()
ObjectStoreClient.empty()
ObjectStoreClient.exists()
ObjectStoreClient.file_ready()
ObjectStoreClient.get_data()
ObjectStoreClient.get_filename()
ObjectStoreClient.get_store_usage_percent()
ObjectStoreClient.size()
ObjectStoreClient.update_from_file()
- pulsar.client.path_mapper module
- pulsar.client.server_interface module
- pulsar.client.setup_handler module
- pulsar.client.util module
- Module contents
- Subpackages
- pulsar.managers package
- Subpackages
- pulsar.managers.base package
- Submodules
- pulsar.managers.base.base_drmaa module
- pulsar.managers.base.directory module
- pulsar.managers.base.external module
- Module contents
BaseManager
DirectoryMaker
JobDirectory
JobDirectory.calculate_path()
JobDirectory.contains_file()
JobDirectory.delete()
JobDirectory.exists()
JobDirectory.has_metadata()
JobDirectory.job_directory_contents()
JobDirectory.load_metadata()
JobDirectory.lock()
JobDirectory.make_directory()
JobDirectory.metadata_directory_contents()
JobDirectory.open_file()
JobDirectory.outputs_directory_contents()
JobDirectory.read_file()
JobDirectory.remove_file()
JobDirectory.remove_metadata()
JobDirectory.setup()
JobDirectory.store_metadata()
JobDirectory.working_directory_contents()
JobDirectory.working_directory_file_contents()
JobDirectory.write_file()
get_id_assigner()
- pulsar.managers.staging package
- pulsar.managers.util package
- Subpackages
- pulsar.managers.util.cli package
- Subpackages
- pulsar.managers.util.cli.job package
- pulsar.managers.util.cli.shell package
- Submodules
- pulsar.managers.util.cli.factory module
- Module contents
- Subpackages
- pulsar.managers.util.condor package
- pulsar.managers.util.drmaa package
- pulsar.managers.util.job_script package
- pulsar.managers.util.cli package
- Submodules
- pulsar.managers.util.aws_batch module
- pulsar.managers.util.env module
- pulsar.managers.util.external module
- pulsar.managers.util.kill module
- pulsar.managers.util.process_groups module
- pulsar.managers.util.pykube_util module
- pulsar.managers.util.retry module
- pulsar.managers.util.sudo module
- pulsar.managers.util.tes module
- Module contents
- Subpackages
- pulsar.managers.base package
- Submodules
- pulsar.managers.queued module
- pulsar.managers.queued_cli module
- pulsar.managers.queued_condor module
- pulsar.managers.queued_drmaa module
- pulsar.managers.queued_drmaa_xsede module
- pulsar.managers.queued_external_drmaa module
- pulsar.managers.queued_pbs module
- pulsar.managers.stateful module
StatefulManagerProxy
StatefulManagerProxy.get_status()
StatefulManagerProxy.handle_failure_before_launch()
StatefulManagerProxy.name
StatefulManagerProxy.preprocess_and_launch()
StatefulManagerProxy.recover_active_jobs()
StatefulManagerProxy.set_state_change_callback()
StatefulManagerProxy.setup_job()
StatefulManagerProxy.shutdown()
StatefulManagerProxy.touch_outputs()
StatefulManagerProxy.trigger_state_change_callback()
- pulsar.managers.status module
- pulsar.managers.unqueued module
- Module contents
ManagerInterface
ManagerInterface.clean()
ManagerInterface.get_status()
ManagerInterface.job_directory()
ManagerInterface.job_stderr_contents()
ManagerInterface.job_stdout_contents()
ManagerInterface.kill()
ManagerInterface.launch()
ManagerInterface.return_code()
ManagerInterface.setup_job()
ManagerInterface.stderr_contents()
ManagerInterface.stdout_contents()
ManagerProxy
ManagerProxy.clean()
ManagerProxy.get_status()
ManagerProxy.job_directory()
ManagerProxy.job_stderr_contents()
ManagerProxy.job_stdout_contents()
ManagerProxy.kill()
ManagerProxy.launch()
ManagerProxy.object_store
ManagerProxy.return_code()
ManagerProxy.setup_job()
ManagerProxy.shutdown()
ManagerProxy.stderr_contents()
ManagerProxy.stdout_contents()
ManagerProxy.system_properties()
- Subpackages
- pulsar.mesos package
- pulsar.messaging package
- pulsar.scripts package
- Submodules
- pulsar.scripts.bootstrap module
- pulsar.scripts.chown_working_directory module
- pulsar.scripts.config module
- pulsar.scripts.drmaa_kill module
- pulsar.scripts.drmaa_launch module
- pulsar.scripts.finish module
- pulsar.scripts.mesos_executor module
- pulsar.scripts.mesos_framework module
- pulsar.scripts.run module
- pulsar.scripts.submit module
- pulsar.scripts.submit_util module
- Module contents
- pulsar.tools package
- pulsar.user_auth package
- pulsar.util package
- Subpackages
- pulsar.util.pastescript package
- Submodules
- pulsar.util.pastescript.loadwsgi module
- pulsar.util.pastescript.serve module
BadCommand
BoolOptionParser
Command
Command.BadCommand
Command.default_interactive
Command.default_verbosity
Command.description
Command.group_name
Command.hidden
Command.logging_file_config()
Command.max_args
Command.max_args_error
Command.min_args
Command.min_args_error
Command.pad()
Command.parse_args()
Command.parse_vars()
Command.quote_first_command_arg()
Command.required_args
Command.return_code
Command.run()
Command.standard_parser()
Command.takes_config_file
Command.usage
DaemonizeException
LazyWriter
NoDefault
NotFoundCommand
ServeCommand
ServeCommand.change_user_group()
ServeCommand.command()
ServeCommand.daemonize()
ServeCommand.default_verbosity
ServeCommand.description
ServeCommand.min_args
ServeCommand.parser
ServeCommand.possible_subcommands
ServeCommand.record_pid()
ServeCommand.requires_config_file
ServeCommand.restart_with_monitor()
ServeCommand.restart_with_reloader()
ServeCommand.show_status()
ServeCommand.stop_daemon()
ServeCommand.summary
ServeCommand.takes_config_file
ServeCommand.usage
difflib
ensure_port_cleanup()
invoke()
live_pidfile()
read_pidfile()
run()
- Module contents
- pulsar.util.pastescript package
- Module contents
- Subpackages
- pulsar.web package
Submodules¶
pulsar.core module¶
pulsar.locks module¶
pulsar.main module¶
Stand-alone entry point for running Pulsar without a web server.
In its simplest form, this method will check the current directory for an
app.yml and run the corresponding configuration as a standalone applciation.
This makes sense when app.yml
contains a message_queue_url
option so
Pulsar is configured to listen to a message queue and doesn’t require a web
server.
The following commands can be used to bootstrap such a setup.:
mkdir pulsar-mq-config
cd pulsar-mq-config
pulsar-config --mq
pulsar-main
This script can be used in a standalone fashion, but it is generally better to
run the pulsar
script with --mode webless
- which will in turn
delegate to this script.
- class pulsar.main.PulsarConfigBuilder(args=None, **kwds)[source]¶
Bases:
object
Generate paste-like configuration from supplied command-line arguments.
- class pulsar.main.PulsarManagerConfigBuilder(args=None, **kwds)[source]¶
Bases:
PulsarConfigBuilder
pulsar.manager_endpoint_util module¶
Composite actions over managers shared between HTTP endpoint (routes.py) and message queue.
pulsar.manager_factory module¶
- class pulsar.manager_factory.ManagerDescription(manager_type='queued_python', manager_name='_default_', manager_options={})[source]¶
Bases:
object