Menu

Chef Supermarket

Adoptable Cookbooks List

Looking for a cookbook to adopt? You can now see a list of cookbooks available for adoption!
List of Adoptable Cookbooks

Supermarket Belongs to the Community

Supermarket belongs to the community. While Chef has the responsibility to keep it running and be stewards of its functionality, what it does and how it works is driven by the community. The chef/supermarket repository will continue to be where development of the Supermarket application takes place. Come be part of shaping the direction of Supermarket by opening issues and pull requests or by joining us on the Chef Mailing List.

View our collection of guides, documentation, and articles

Cookbooks
Advanced Options

Select Badges

Select Supported Platforms

Select Status

RSS

apache_hadoop (2) Versions 0.1.1

Installs/Configures the Apache Hadoop distribution

Policyfile
Berkshelf
Knife 
cookbook 'apache_hadoop', '~> 0.1.1', :supermarket
cookbook 'apache_hadoop', '~> 0.1.1'
knife supermarket install apache_hadoop
knife supermarket download apache_hadoop
README
Dependencies
Quality 17%

Apache Hadoop cookbook

Apache License 2.0

Requirements

This cookbook has been tested on the following versions (but may work on earlier ones):

  • Chef 12.3.0+
  • CentOS 7.0+
  • Ubuntu 14.04+

Recipes

  • install.rb - Installs the Apache Hadoop Binaries
  • nn.rb - Configures and starts the NameNode
  • dn.rb - Configures and starts the DataNode
  • rm.rb - Configures and starts the ResourceManager
  • nm.rb - Configures and starts the NodeManager
  • jhs.rb- Configures and starts the JobHistoryServer
  • ps.rb - Configures and starts the ProxyServer

Karamel usage

This cookbook is karamelized (www.karamel.io). You can launch a Hadoop Cluster using the following yml file. It will create 3 VMs, where one is the master running NameNode, ResourceManager, and Job history server. The two other VMs are workers and will run the DataNode and NodeManager.

name: eu-west-1

cookbooks:                                                                      
  apache_hadoop: 
    github: "hopshadoop/apache-hadoop-chef"
    tag: "v0.1.0"

groups: 
  namenodes:
    size: 1
    recipes: 
        - apache_hadoop::nn
        - apache_hadoop::rm
        - apache_hadoop::jhs                                                            
  datanodes:
    size: 2
    recipes: 
        - apache_hadoop::dn
        - apache_hadoop::nm

Authors

Authors:: Jim Dowling. (jdowling@kth.se), Marc Bux

License

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this software except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Dependent cookbooks

kagent >= 0.0.0
java >= 0.0.0
sysctl >= 0.0.0
cmake >= 0.0.0

Contingent cookbooks

drelephant Applicable Versions
drelephant 0.1.0
drelephant 0.1.1
epipe Applicable Versions
epipe 0.1.0
epipe 0.1.1
flink Applicable Versions
flink 0.1.1
flink 0.1.2
flink 0.1.3
hadoop_spark Applicable Versions
hadoop_spark 0.1.2
hadoop_spark 0.1.3
hops Applicable Versions
hops 0.1.0
hops 0.1.1
hopsworks Applicable Versions
hopsworks 0.1.0
livy Applicable Versions
livy 0.1.1
zeppelin Applicable Versions
zeppelin 0.1.2

Collaborator Number Metric 
            
0.1.1 failed this metric
Failure: Cookbook has 0 collaborators. A cookbook must have at least 2 collaborators to pass this metric.

Contributing File Metric 
            
0.1.1 failed this metric
Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must contain a CONTRIBUTING.md file

Foodcritic Metric 
            
0.1.1 failed this metric
FC007: Ensure recipe dependencies are reflected in cookbook metadata: apache_hadoop/recipes/install.rb:109
FC009: Resource attribute not recognised: apache_hadoop/recipes/install.rb:56
FC026: Conditional execution block attribute contains only string: apache_hadoop/recipes/default.rb:142
FC033: Missing template file: apache_hadoop/recipes/nn.rb:52
FC033: Missing template file: apache_hadoop/recipes/nn.rb:59
FC034: Unused template variables: apache_hadoop/templates/default/capacity-scheduler.xml.erb:1
FC034: Unused template variables: apache_hadoop/templates/default/hdfs-site.xml.erb:1
FC034: Unused template variables: apache_hadoop/templates/default/yarn-site.xml.erb:1
FC043: Prefer new notification syntax: apache_hadoop/recipes/dn.rb:72
FC043: Prefer new notification syntax: apache_hadoop/recipes/jhs.rb:57
FC043: Prefer new notification syntax: apache_hadoop/recipes/jhs.rb:95
FC043: Prefer new notification syntax: apache_hadoop/recipes/nm.rb:32
FC043: Prefer new notification syntax: apache_hadoop/recipes/nm.rb:69
FC043: Prefer new notification syntax: apache_hadoop/recipes/nn.rb:135
FC043: Prefer new notification syntax: apache_hadoop/recipes/ps.rb:54
FC043: Prefer new notification syntax: apache_hadoop/recipes/rm.rb:105
FC064: Ensure issues_url is set in metadata: apache_hadoop/metadata.rb:1
FC066: Ensure chef_version is set in metadata: apache_hadoop/metadata.rb:1
FC069: Ensure standardized license defined in metadata: apache_hadoop/metadata.rb:1
FC070: Ensure supports metadata defines valid platforms: apache_hadoop/metadata.rb:1
FC072: Metadata should not contain "attribute" keyword: apache_hadoop/metadata.rb:1
FC121: Cookbook depends on cookbook made obsolete by Chef 14: apache_hadoop/metadata.rb:1
FC122: Use the build_essential resource instead of the recipe: apache_hadoop/recipes/install.rb:109
Run with Foodcritic Version 16.3.0 with tags metadata,correctness ~FC031 ~FC045 and failure tags any

No Binaries Metric 
            
0.1.1 passed this metric

Testing File Metric 
            
0.1.1 failed this metric
Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must contain a TESTING.md file

Version Tag Metric 
            
0.1.1 failed this metric
Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must include a tag that matches this cookbook version number

Jim Dowling Jim Dowling

Details

View Source

Updated August 31, 2016 Created on

Supported Platforms

  • rhel >= 0.0.0
  • centos >= 0.0.0
  • debian >= 0.0.0
  • ubuntu >= 0.0.0

License

GPL 2.0

Download Cookbook