Difference: SmartStackSetup (2 vs. 3)

Revision 32013-10-29 - rprior

Line: 1 to 1
 
META TOPICPARENT name="ShoalDevelopment"

Smartstack Airbnb

Line: 41 to 41
  Smartstack:
  • nerve:
Changed:
<
<
    • -
>
>
    • ruby 2
 
  • synapse:
Changed:
<
<
    • -
>
>
    • ruby 2
    • as of now because the version in gem does not work, git
 
  • zookeeper:
    • Java 1.6 (JDK6)
Added:
>
>
* zookeeper
  Shoal:
  • shoal-agent:
Line: 88 to 90
 }
Changed:
<
<
Nerve can then be run by (assuming squid is already running): nerve --config /path/to/config
>
>
Nerve can then be run by (assuming squid and zookeeper are already running): nerve --config /path/to/config
 
Changed:
<
<
Zookeeper:
>
>
Zookeeper (Starting from cernvm-basic-2.7.2-1-2-x86_64.ext3.gz):
  • get Java (JDK6 or JRE 1.6)
  • java does not require install just make sure the jre/bin/ directory is on the path
  • (export PATH=$PATH:/path/to/jre/bin/)
  • Download zookeeper from a mirror here http://www.apache.org/dyn/closer.cgi/zookeeper/
  • zookeeper does not require install
  • A zoo.cfg config file will need to be created in zookeeper/conf (or just rename zoo_sample.cfg to zoo.cfg)

Run by executing zookeeper/bin/zkServer.sh start

Synapse (Starting from cernvm-basic-2.7.2-1-2-x86_64.ext3.gz):

  • Get ruby from here
  • tar xvzf -> ./configure -> make && make install
  • As of this writing, running "gem install synapse" will install synapse, but cannot properly run using zookeeper

This is fixed in the git hub repo

git clone https://github.com/airbnb/synapse.git

A config file has to be provided as well a sample one is given below: (under services->squid->discovery change hosts to be a list of zookeeper IPs and ports (2181 by default) With this config change CVMFS_HTTP_PROXY to localhost:3129 (as specified under services->squid->local_port

{
  "services":
  {
    "squid" :
    {
      "name": "squid",
      "local_port": 3219,
      "server_options": "check inter 2000 rise 3 fall 2",
      "discovery":
      {
        "method": "zookeeper",
        "path": "/nerve/services/squid/services",
        "hosts": ["149.165.148.122:2181"]
      },
      "haproxy":
      {
        "port": 3213,
        "server_options": "check inter 2s rise 3 fall 2"
      }
    }
  },
  "haproxy":
  {
    "reload_command": "sudo service haproxy reload",
    "config_file_path": "/etc/haproxy/haproxy.cfg",
    "socket_file_path": "/var/haproxy/stats.sock",
    "do_writes": false,
    "do_reloads": false,
    "do_socket": false,
    "global":
    [
      "daemon",
      "user haproxy",
      "group haproxy",
      "maxconn 4096",
      "log 127.0.0.1 local0",
      "log 127.0.0.1 local1 notice",
      "stats socket /var/haproxy/stats.sock mode 666 level admin"
    ],
    "defaults":
    [
      "log global",
      "option dontlognull",
      "maxconn 2000",
      "retries 3",
      "timeout connect 5s",
      "timeout client 1m",
      "timeout server 1m",
      "option redispatch",
    ]
  }
}
 
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback