ProjectsGeek

Climatic Data analysis using Hadoop Project

January 25, 2018 by ProjectsGeek Leave a Comment

Climatic Data analysis using Hadoop

Objective

To analyze the climatic data using Hadoop to extract significant knowledge for the purpose of better decision-making.

Project Overview

The climate is very important factor factors in many perspectives such as business, tourism, etc., This climatic data influence success of many operations. For example, temperature and rainfall in one area is not same for other area. So it is important to analyze the climatic data in different regions, for the purpose of better decision making and precaution measures.

This project tries an attempt to analyze the climatic data of various regions.Climate data are radically increasing in volume and complexity. So the concept of big data emerges here. Hadoop, MapReduce big data concept is used here to analyze the climatic data for the purpose of better understanding and decision-making.

Proposed System

The proposed system focuses on analyzing climate related data using Hadoop. The proposed system architecture is shown in the figure.

Figure: Proposed System Architecture

Step1: Data Preparation

Data Selection: The required data set is collected from the website https://knoema.com/atlas/India/topics/Climate-Change/datasets.

Data Loading: The collected data set loaded into Hadoop Distributed File System environment. Hadoop is the great tool to predict the climatic conditions, with processing of large and dynamic climate data.

Data Pre processing: The collected data set might consist of inconsistent data. If climatic analysis is performed on this data, it will produce wrong outcomes. Therefore, necessary pre processing techniques are applied before analyzing the data.

Step 2: Climatic Data Analysis

Climatic Data Analysis: Pre processed data set is now analyzed using machine learning and statistics. Prediction techniques like regression are applied to the climate data to predict the future climate in the city.

Step 3: Reports

Report Generation: After the climate data analysis, the necessary reports are generated and visualized. Bar charts and line charts are used along with the table format. Inferences and conclusions are derived from the analyzed data.

Statistics Questions

Find the mean and median of the maximum temperature on an hourly basis
Find the mean and median of the minimum temperatureon an hourly basis
Identify the rate of change of daily average temperature
Identify the rate of change of weekly average temperature
Identify the rate of change of monthly average temperature
Data points in the various cities

Machine Learning

Clustering: Identify the regions that are close to each other based on the climatic conditions.
Classification: The climate data set is classified, based on whether it will be a sunny day or rainy day day depending on the temperature.
Prediction: Predict the next day climate in the city with the possible rate of change compared to existing climate.

Software Requirements

Linux OS
MySQL
Hadoop & MapReduce

Hardware Requirements

Hard Disk – 1 TB or Above
RAM required – 4 GB or Above
Processor – Core i3 or Above

Technology Used

Big Data – Hadoop
Machine Learning
Statistics

Airline On-Time Performance Hadoop Project

January 24, 2018 by ProjectsGeek Leave a Comment

Airline On-Time Performance

Objective

The objective is to analyze the airline data to provide the airline on time performance statistics to the end user using R programming.

Project Overview

Airline on time performance refers the service success rate by the airlines based on the schedule. Airline delay is the most important issue in the airline industry, because it will lead to economic crisis in the airline business for the owners. This project analyses the airline data to provide the necessary statistics related to airline on time performance.One of the research study shows that that every year nearly 20% of airlines are delayed or cancelled. This delay or cancel makes big issue is airline industry for their service and their business. It affects both travellers and airlines in big way.

The project focuses on extracting airline on time performance statistics based on airline data history using R programming. Factors like weather, issues in scheduling, passenger arrival delay and etc., are causing the airline delay. The airline on time performance is measured by the following formula.

On-Time Performance = (On-Time Service/Total Number of Services)*100%

Proposed System

The proposed system concentrates on analyzing airline data history to provide the important and interesting statistics related to airline on time performance. The proposed system architecture is shown in the figure.

Airline On-Time Performance Figure: Proposed System Architecture

Module 1:Data Collection

The required data set US Department of Transportation airline on-time performance datais collected from the web. The attributes of the data set are origin, destination, date, early time and late time.

Module 2: Data Preparation

The collected raw data set is loaded into MySQL database with R integration. This raw data is susceptible to missing data and noisy data. So necessary preprocessing techniques like data cleaning methods applied to the data set to replace missing values and to smooth the noisy data.

Module 3: Statistics

The pre processed data set is processed in R tool to identify the important statistics. R packages dplyrand ggplot2 are used here to generate the necessary statistics.

Statistics answers the following,

Number of airlines from same origin
Number of airlines to same destination
Arrival delay reasons
- Late Aircraft
- Weather
- Security
- Carrier
- National Aviation System
Cancellations
- Weather
- Carrier
- National Aviation System

Module4: Data Visualization

The extracted statistics and information are visualized using R packages dplyr and ggplot2.

Benefits

This project is used to find the interesting factors for airline on time performance. So business owners will benefit from the statistics by making better decisions in future ad understand the business thoroughly.
Travelers will find the user friendly airline based on the airline on time performance statistics.

Software Requirements

Windows
MySQL
R

Hardware Requirements

Hard Disk – 500 GB or Above
RAM required – 4 GB or Above
Processor – Core i3 or Above

Technology Used

Statistics
Business Intelligence

Search Engine using Python Project

January 23, 2018 by ProjectsGeek Leave a Comment

Objective

To develop web based Search Engine application using python scripting language to provide an excellent searching platform on the internet for the users.

Existing System

The traditional Search Engine was able to produce the results for the user’s requirements. But the question of efficient result is the biggest challenge for any search engine project. Few times only users happy with the search results given by search engines. Most of the time search engine failed to produce the required search result requested by the user. Most of the users not very much satisfied with the existing system.

Figure: Existing System Architecture

Proposed System

In order to solve the problems in the existing system, the proposed system uses the latest algorithms such as search engine optimization technique, page ranking, indexing and web crawling. This will provide the best search results to the users. The unique and distinct search result is displayed by the proposed search engine to the user’s query.

Figure: Proposed System Architecture

A number of web links are indexed, whenever a keyword is searched by the user using this Search Engine application. The analysis is performed for the data in the indexed links. This task is achieved by page rank algorithm. Finally, the web page containing the top match to the key word is showedto the user in the first link of the result page.

Modules

Search: User search for the particular query in the search engine. This user query is saved for further processing.
Indexing: After a user searches for the particular keyword, database matching those keywords is identified. Then number of web links relevant to this query areindexed.
Analyzing: Then to retrieve the best possible match, this search engine application uses page ranking, web crawling and search engine optimization.
Result Retrieval:After analyzing, the best matching result is retrieved and it is displayed in the user interface window to the user.

Advantages

It provides the best search result for the user by using the latest tools, algorithms and technologies.
It uses the features such as search engine optimization, web crawling, indexing, page ranking etc. to extract the exact and fast result.
This can be utilized from any geographical location, as long as there is availability of the internet service.

Software Requirements

Windows OS
Python IDE – Spyder IDE (Or) Jupyter Notebook
SQL

Hardware Requirements

Hard Disk – 500 GB or Above
RAM required – 4 GB or Above
Processor – Core i3 or Above

Aadhar Based Analysis using Hadoop Projects

January 22, 2018 by ProjectsGeek Leave a Comment

Objective

To analyze the Aadhar data using Hadoop to extract meaningful knowledge for the purpose of better decision-making by the central and state government.

Project Overview

The worlds largest democracy, India is the second largest nation in terms of population, with 1.3 billion population. Among these, 99% of adult population enrolled for Aadhar, the unique identity provided by the Government of India for diverse purposes. The government maintains the Aadhar related data in digital format. https://data.uidai.gov.in/uiddatacatalog/dataCatalogHome.do website provides the access to Aadhar card related data set. The Public can access some of the sources of these data and they can analyze to extract useful information and generate reports.

The data set covers more than 99% adult population of our nation. So the amount of data generated by Aadhar is very huge. Similarly, all the data collected for this unique identity is not in structured data. It also consists of unstructured and semi-structured data. Also, the enrollment is still in the process. The processing speed of this data generation is high. Therefore, theses characteristics come under the big data concept.

The purpose of Hadoop is storing and processing large amount of the data. So this project uses the Hadoop for processing Aadhar data. The input data is processed using MapReduce and then result is loaded into Hadoop Distributed File System (HDFS). Finalreports generated using Tableau (Business Intelligence Software).

Proposed System

The proposed system concentrates on analyzing Aadhar related data using Hadoop for the purpose of better decision making by the Government of India. The proposed system architecture is shown in the figure.

Step 1: Data Preparation

Data Selection: The required data set is collected from the government web portal.

Data Loading: The collected data set loaded into Hadoop Distributed File System environment.

Data Pre processing: The collected data set might consist of missing values and noisy data. If analysis is performed on this data, it may lead to wrong results. So to avoid this, data pre processing is done on the data set.

Step 2: Data Analysis

Data Analysis: Now the collected data set is ready for data analysis. Descriptive statistics like mean, median, mode, percentile are applied.

Step 3: Results

Report Generation: After the data analysis, the analyzed results need to be visualized. Tableau can be used for this purpose. Bar charts, Line charts and Pie charts are generated along with the table format.

Statistics Questions

Identify the total number of cards approved by gender wise
Identify the total number of cards approved by state wise
Identify the total number of cards approved by age wise
Identify the total number of cards approved in rural areas
Identify the total number of cards approved in rural areas
Identify the total number of cards approved in city areas
Identify the number cards rejected by government (State wise)
Identify the number cards rejected by government (Gender wise)
Identify the number cards rejected by government (Age wise)

Advantages

Government can immediately take corrective measures for the issues found in the Aadhar card related data analysis.
Central and state government can take necessary precaution measurements to avoid the issues in future.

Software Requirements

Linux OS
MySQL
Hadoop&MapReduce
Tableau

Hardware Requirements

Hard Disk – 1 TB or Above
RAM required – 8 GB or Above
Processor – Core i3 or Above

Technology Used

Big Data – Hadoop
Statistics

Apartment Management System Project

January 6, 2018 by ProjectsGeek Leave a Comment

Apartment Management System

The main objective of this application is to help the construction industry users to manage the operations and activities of apartments. This is a simple user interface developed using .net technology. It helps the user to keep track of all the sales, purchases, Billing, invoices, maintenance related information of the different apartments of a particular construction firm. It helps the construction companies to reduce the cost of maintaining these records.

There will be a robust database which stores all the data related to these various apartments, their maintenance related information etc. It helps to keep track of all the payments done by customers towards maintenance advances or purchases etc. This tool will ease the user to manage huge data of different customers who own apartments from the same builder. It will record the date of purchase, the amount paid, the mode of payment. It shall also have the data related to the installment the user has opted for. For the maintenance part of the interface it shall have the data of all the maintenance charges paid by the customers, whether its done quarterly or annually. It also records the mode of payment. It will also hold all the details such as the apartment number, the area of the house (sq. ft.) bought etc.

Existing System

The existing records were manually manged by the resources of the construction company. It was a huge task as they had to maintain a large database of customers who have bought the flats along with their dates, amount paid etc. They also had to manage the data related to the maintenance activities of all the flat owners. It required lot of time and resources. There was no way to find easily when the customer had to pay the installment for maintenance, etc details. The user had to manually search for all the records pertaining to each apartment and then prepare a report of all the outstanding payments.

Proposed System

This is a simple user interface developed using .net technology. The interface helps the user to login through the system and add the details regarding the apartment. The interface takes as input the name of the customer, Phone number, address, the apartment number, Area of the house, Amount per square foot etc. These details are stored in the database. If the apartment is sold to the customer, then these details are stored in the sales tables. It will have a unique sale deed number generated for each of the flats. The interface also has maintenance panel. This panel holds information such as name of the owner, the date of purchase, the maintenance charges to be paid, quarterly or annually, Mode of payment etc. These details are stored in the maintenance tables in the database. The user can query on the database and fetch this information very easily. This interface helps the user to make all these payments regarding maintenance and purchase of flats etc.

System Specifications

Modules

Sales details: This module shall hold the details related to the sales of flats in an apartment complex. It includes the name of the customer, Address, phone number, the block name, house number and the area of the house, Amount per square foot details.It has a unique sales deed number generated for each of the house registered.

Maintenance Module: The maintenance related activities are handled by this module. It holds data such as the name of the owner, address, phone number, house number, area of the house registered, quarterly or annual payment of charges, and the amount that has to be paid towards maintenance. It shall also take care of the receipts that needs to be generated for each of the payments.

Hardware configuration

Intel dual core Processor
RAM 512 MB
20 GB Hard disk
Key board
Mouse

Software configuration

Operating system Windows XP Professional
Environment Visual studio NET 2005 4.6
Language VB.net

Download Project

Apartment Management System Abstract

Download Abstract

School Enrollment System Project

December 31, 2017 by ProjectsGeek Leave a Comment

The main objective of this School Enrollment System application is to automate the process of enrollment of students into a school or educational institution. It helps the administrator to enter all the details regarding the new student into the system. This interface is developed using VB.net environment. It has a simple database connectivity to MS Access. All details related to the new admission shall get stored in respective tables in the database. It takes as input many fields like the student first name, last name, Date of birth, gender, religion, which grade he shall be admitted etc. These details get saved in the database. School Enrollment System also takes inputs such as place of birth, house address, Name of school last attended and the address of that school. These details also shall be stored. Whenever the administrator has to check for the details of that student, he can search for the student and that record shall be displayed to the user in a list view. The user can add student details and update them also. The user shall be able to generate reports based on the student selected.

Existing System

Earlier there was no tool to save the enrollment details of student. These details were stored manually in registers. The administrator had a difficult task to maintain these records. If the user had to search for any particular student, he had to check for all the files. It was a laborious task. There was no easy way to update the details of the new student. It took lot of resources and time to manage all these accounts in the school.

Proposed School Enrollment System

This is as simple user interface School Enrollment System is developed in visual Basic. It helps the user to enroll students into the institute. The simple interface takes as input fields like first name, middle name, Last name, date of birth, gender, religion details and saves it to the database. It also takes fields such as which class he shall be admitted and the previous school attended. School Enrollment System will ease the user to generate reports based on the student selected. The interface has strict error handling at the user level. The date of birth fields is validated for the date field. Some of the fields are a list control which will allow user to only select a specific value. These entries will be saved in the database. The user also can update the student details record. In the list view, the user can select a particular student and the details shall get displayed on the screen. This School Enrollment System is developed using VB .net. It reduces the time taken by the user to enroll candidates. It helps the user to generate reports for each student selected. It shall capture the details regarding the fees that is paid for that academic year during admission process. It will also check if the student is being transferred from other branches or is a new admission. These details which are recorded in the database shall help the user to manage the enrollment activities easily.

System Specifications

Modules

Student details: This module shall have the details regarding the student such as the student first name, last name, gender, date of birth, address, Grade which the student will be admitted, previous school attended etc.

Hardware configuration

Processor – Intel dual core
RAM – 512 MB
Hard disk – 40 GB
Floppy drive – 1.44 MB
Key board

Software configuration

Windows XP Professional
Visual Basic 6.0
MS Access

Download Project

School Enrollment System Absract	Download Abstract
School Enrollment System Code	Download Source Code

ProjectsGeek

Climatic Data analysis using Hadoop

Objective

Project Overview

Proposed System

Statistics Questions

Machine Learning

Software Requirements

Hardware Requirements

Technology Used

Other Projects to Try:

Airline On-Time Performance

Objective

Project Overview

Proposed System

Benefits

Software Requirements

Hardware Requirements

Technology Used

Other Projects to Try:

Objective

Existing System

Proposed System

Modules

Advantages

Software Requirements

Hardware Requirements

Other Projects to Try:

Objective

Project Overview

Proposed System

Step 1: Data Preparation

Step 2: Data Analysis

Step 3: Results

Statistics Questions

Advantages

Software Requirements

Hardware Requirements

Technology Used

Other Projects to Try:

Apartment Management System

Existing System

Proposed System

System Specifications

Hardware configuration

Software configuration

Download Project

Other Projects to Try:

Existing System

Proposed School Enrollment System

System Specifications

Hardware configuration

Software configuration

Download Project

Other Projects to Try:

Footer