Skip to content
Snippets Groups Projects
  1. Mar 14, 2015
    • John Chilton's avatar
      Project updates for pip install under Windows · fd666541
      John Chilton authored
      - Just add PyYaml as required dependency - doesn't seem problematic
      under Windows.
      - Update setup.py to conditionally install nix bash script or Windows
      bat script depending on platform.
      - Outline some work on bootstrapping Pulsar install via PyPI (should be
      merged into scripts/config.py at some point).
      - Version update to PyPI publication tests.
      fd666541
  2. Mar 01, 2015
    • John Chilton's avatar
      Make Pulsar useful from pip install. · 37d72821
      John Chilton authored
       - Add pulsar-config script that sets up a directory with server.ini
         file describing web process and app.yml describing Pulsar
         configuration..
       - Move run.sh into scripts and rename to just 'pulsar', modify behavior
         to target configuration files in current working directory or directory
         specified by -c/--config or PULSAR_CONFIG_DIR.
       - Add a new mode `--mode webless` to pulsar/run.sh that acts as an
         entry point into pulsar.main and starts pulsar without a webserver
         for MQ operation.
       - Move test/check.py into pulsar/clint/test/check.py so it is installed
         with pip. Add entry point so 'pulsar-check' is available after installing
         pulsar via pip/setup.py.
      37d72821
  3. Sep 22, 2014
  4. Sep 21, 2014
  5. Jun 19, 2014
  6. Jun 15, 2014
    • John Chilton's avatar
      Add Apache Mesos framework for LWR (prototype). · 5888810b
      John Chilton authored
      One possible way to test.
      
      - Setup Mesos cluster (for testing see https://github.com/mesosphere/playa-mesos).
      - Install LWR on Mesos cluster.
      - Install Mesos client into LWR virtualenv (e.g. easy_install http://downloads.mesosphere.io/master/ubuntu/14.04/mesos-0.19.0_rc2-py2.7-linux-x86_64.egg)
      - Configure LWR to talk to a message queue (set message_queue_url in server.ini and ensure pycurl is available).
      - Configure Galaxy to submit to this LWR instance via message queue (see notes in job_conf.xml.sample_advanced).
      - Run new LWR Mesos framework process passing it host and port Mesos master.
      
        ./script/mesos_framework --master=10.141.141.10:5050
      
        Can also pass this command --manager, --ini_path, --app to target a different manager or a "paste" app other than default of main in server.ini.
      
      - Run a Galaxy job.
      
      Limitations: Probably several of these - most obvious to me is these processes are not dying cleanly (because of non-daemon message queue threads I guess) and cancelling jobs in Galaxy has no effect. Need to reconsider how to do this (cli-based submission has same limitation and can probably be fixed at same time). Then of course there is the ever present lack of documentation.
      5888810b
  7. Jun 04, 2014
  8. Sep 25, 2013
  9. Sep 24, 2013
  10. Sep 09, 2013
Loading