Difference: CloudschedulerPaperOutline (5 vs. 6)

Revision 62019-07-02 - crlb

Line: 1 to 1
 
META TOPICPARENT name="RandallSobie"
CSV2 journal paper
Line: 9 to 9
  CS first version
  • motivation for original CS system and its design
Added:
>
>
    • Take advantage of opportunistic virtual resources.
 
    • Monolithic, multi-threaded python 2 module with in-memory data structures.

  • performance
  • limitations and issues
Added:
>
>
    • constrained to one node.
    • Single job scheduler.
 
    • CLI user interface only.
    • Scaling.

CS second version

Changed:
<
<
  • design goal and new use cases
>
>
  • Use cases
    • Multiple Projects/Users/Condors
    • Simplified/Remote management (CLI/GUI)
    • Layered management of the resources
    • Built in status monitoring (as opposed to external tracking)
    • More effective use of resources (auto scaling)
    • Improved diagnostics
    • Run on any cloud type
    • Integrated image & SSH key management (glint)

  • Design goal
    • Useability & maintainability.
    • Latest software packages
    • Use standard based open source software, develop only when needed
    • Database centric (maintains state, easily extensible, crash recovery)
    • Improved maintenance options & state recovery by reducing number of critical components
    • Modular components
    • General purpose (not HEP specific)
    • Allow user complete control of VM contextualization
    • Abstraction of cloud type
 
  • architecture
Added:
>
>
    • Based on Openstack database centric model (Groups/Projects, Users assigned to groups)
    • Check for Openstack papers on architecture
 
  • implementation
Added:
>
>
    • Retain condor as job scheduler because of it's dynamic resource management
    • Mariadb, apache, python3, amqp, influxDB, celery, Jinja2, html5, css, javascript, centos7
 
  • monitoring, accounting and alerting
Added:
>
>
* timeseries * ???
 
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback