HTTP Fs Installation

-

Some steps are specific to MapR Cluster. Ignore those steps.

1. Setup Yum repositories for MapR

2. Check for the packages

          yum list mapr-httpfs

3. Install ==> yum install mapr-httpfs

4. Configure the core-site.xml and httpfs-site.xml properties to add impersonations
                                      
          <property>
              <name>hadoop.proxyuser.#HTTPFSUSER#.hosts</name>
              <value>httpfs-host.foo.com</value>
          </property>
            <property>
                   <name>hadoop.proxyuser.#HTTPFSUSER#.groups</name>
                   <value>*</value>
            </property>
              
          Replace the #HTTPFSUSER# with the mapr user

5. start the httpfs service

              /opt/mapr/httpfs/httpfs-1.2/bin/httpfs.sh start

6. Make sure the service is running on port 14000

7. Run ./configure.sh -R to make the service configuration refreshed and the httpfs service will be visible in MCS


Testing the installation
Curl some path in file system from terminal


This will list the files under the directory


Refer here for using Httpfs




Comments

Post a Comment

Popular posts from this blog

Querying MapR DB tables from Drill

-
1. Create a storage plugin for maprDB in drill Web UI {     "type" : "hbase",      "enabled" : true,               config" : { "hbase.table.namespace.mappings" : "*:/tables" #Change the path where you have mapr tables } } 2. Connect to drill ./sqline !connect jdbc:drill:zk=10.10.71.12:5181   sqlline> !connect jdbc:drill:zk=10.10.71.12:5181 scan complete in 406ms Enter username for jdbc:drill:zk=10.10.71.12:5181: mapr Enter password for jdbc:drill:zk=10.10.71.12:5181: **** 0: jdbc:drill:zk=10.10.71.12:5181> 3. Change the storage plugin to maprdb (or the name you have given) 0: jdbc:drill:zk=10.10.71.12:5181> use maprdb; +-------+-------------------------------------+ |  ok   |               summary               | +-------+-------------------------------------+ | true ...
Read more

OpenSSL Certificate creations

-
Create Self Signed Certificate Here are the steps involved in creating self signed certificate a) Create a key b) Generate Certificate Sign request .csr c) Sign your certificate (As it is self signed) a) Create a key Create a directory first (to avoid confusions) #mkdir certificates #cd certificates Generate key file #openssl genrsa 1024 > private.key b) Generate Certificate Sign request .csr #openssl req -new -key private.key > certrequest.csr c) Sign your certificate (As it is self Signed) #openssl x509 -in certrequest.csr -out selfsigned.crt -req -signkey private.key -days 365 Here the -days is the number of days denotes the validity of certificate Once after this we can get the certificate as file "selfsigned.crt"
Read more