PIG and .bashrc file

manojpjohn

Hi,

I couldn't find the /home/hduser/.bashrc file in the vm. Is it necessary to edit this file on a pre-configured cloudera vm. I can use the grunt shell anyway. But please let me know why I cannot find the directory /home/hduser

Regards
John

PIG Installation

Aug 04 2014 01:15 PM

3 Answer(s)

DeZyre Support

hi John,

If you have created a user called "hduser" them this user need to have a home directory "/home/hduser" . On some linux systems the system created users will had .bashrc, for the users which the user creates, this file might not be there. You can create a .bashrc file and put the required paths into this file.

once paths are added, execute "source .bashrc" on the shell to access the variables and use on the command line.

Thanks

Aug 04 2014 02:38 PM

DeZyre Support

Aug 04 2014 02:39 PM

manojpjohn

Thanks for the response. Does it have to be hduser and hduser folder. As I'm using cloudera user, can it be created in cloudera folder?

Also what's the significance of this .bashrc file and the path. I can use PIG commands without these steps on the VM downloaded. Please let me know if it's really necessary or is there any other location where .bashrc located which I'm not aware of?

Regards
John

Aug 04 2014 02:48 PM

Relevant Projects

Predict Churn for a Telecom company using Logistic Regression

Machine Learning Project in R- Predict the customer churn of telecom sector and find out the key drivers that lead to churn. Learn how the logistic regression model using R can be used to identify the customer churn in telecom dataset.

Data Science Project - Instacart Market Basket Analysis

Data Science Project - Build a recommendation engine which will predict the products to be purchased by an Instacart consumer again.

Machine Learning Project to Forecast Rossmann Store Sales

In this machine learning project you will work on creating a robust prediction model of Rossmann's daily sales using store, promotion, and competitor data.

Time Series LSTM forecasting

In this project, we will use time-series forecasting to predict the values of a sensor using multiple dependent variables. A variety of machine learning models are applied in this task of time series forecasting. We will see a comparison between the LSTM, ARIMA and Regression models. Classical forecasting methods like ARIMA are still popular and powerful but they lack the overall generalizability that memory-based models like LSTM offer. Every model has its own advantages and disadvantages and that will be discussed. The main objective of this article is to lead you through building a working LSTM model and it's different variants such as Vanilla, Stacked, Bidirectional, etc. There will be special focus on customized data preparation for LSTM.

Convolutional RCCn's for extracting the text out of images

CRNNs combine both convolutional and recurrent architectures and is widely used in text detection and optical character recognition (OCR). In this project, we are going to use a CRNN architecture to detect text in sample images. The data we are going to use is TRSynth100k from Kaggle. Given an image containing some text, the goal here is to correctly identify the text using the CRNN architecture. We are going to train the model end-to-end from scratch.

Locality Sensitive Hashing Python Code for Look-Alike Modelling

In this deep learning project, you will find similar images (lookalikes) using deep learning and locality sensitive hashing to find customers who are most likely to click on an ad.

Customer Churn Prediction Analysis using Ensemble Techniques

In this machine learning churn project, we implement a churn prediction model in python using ensemble techniques.

Hadoop Project for Beginners-SQL Analytics with Hive

In this hadoop project, learn about the features in Hive that allow us to perform analytical queries over large datasets.

Machine Learning or Predictive Models in IoT - Energy Prediction Use Case

In this machine learning and IoT project, we are going to test out the experimental data using various predictive models and train the models and break the energy usage.

Spark Project-Analysis and Visualization on Yelp Dataset

The goal of this Spark project is to analyze business reviews from Yelp dataset and ingest the final output of data processing in Elastic Search.Also, use the visualisation tool in the ELK stack to visualize various kinds of ad-hoc reports from the data.

Learn how you can build Big Data Projects