Group 3 - Project - SG Real Estate Augmented Data Preparation by Balamurugan M https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym Team Members: Balamurugan Marudhai | Pang Kim Yang, Francis | Rachel Tan Wei Ling | Sunicha Tumtup | Nur Farlina Binte Ali, Lynn | Soh Youshen, Lester en-us 2020-05-24 17:53:30 UTC 2024-12-19 05:19:49 UTC hello@padlet.com https://padlet.net/icons/png/1f3e8.png Project Description balamuruganmarudhai https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/591662171                                                                                                                                             Presenter: Francis
Real Estate Data For Singapore

For a property investor, it is important to know the sales price as well as the potential rental income generating from a property. URA website provides both sales and rental information. However, they are presented in separate reports. In this project, we will prepare the 3 datasets from URA and attempt to present both the average sales price and average gross rent of the properties in a summarized report. 

The scope of the project will cover:
  • Non-landed private properties
  • Sales & rental in Year 2019
  • Single unit sales
]]> 2020-05-24 17:53:30 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/591662171 ACCESS balamuruganmarudhai https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/591662172   Presenter: Sunicha
In this project, we will use the 3 datasets obtained from the URA website:
1. Rental data
2. Sales data
3. District data

Source: https://www.ura.gov.sg/realEstateIIWeb/transaction/search.action
https://www.ura.gov.sg/realEstateIIWeb/resources/misc/list_of_postal_districts.htm
]]> 2020-05-24 17:53:30 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/591662172 EXPORT balamuruganmarudhai https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/591662180                                          Presenter: Lynn
RENTAL_MAIN]]> 2020-05-24 17:53:30 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/591662180 Augmented Data Preparation - Tasks balamuruganmarudhai https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/591662183                                                                                                                                                     Presenter: Bala
The following tasks are carried out by our team members:]]> 2020-05-24 17:53:30 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/591662183 Augmented Data Preparation - Overview balamuruganmarudhai https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/604630866                                                                                                                                               Presenter: Farlina]]> 2020-06-01 12:12:15 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/604630866 RENTAL DATA 2080701b1 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/605942430                                                                        Presenter: Francis]]> 2020-06-02 01:19:13 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/605942430 TASK 3 2080701b1 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/605944059 CLEAN: Clean column [Project Name].
REASON: Column [Project Name] contains generic description 'Non-Landed Housing Development' instead of actual project name.
ACTION: Filter and delete 'Non-Landed Housing Development' data records  (total 1944 rows)
REASON: Data without project name is not useful for analysis]]> 2020-06-02 01:21:05 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/605944059 TASK 1 2080701b1 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/605947607 BLEND: Combine the 6 rental datasets into a complete rental datasets (districts 1 - 28)
ACTION: Use Union to stack the 6 rental datasets
REASON: The raw rental data from URA are split into 6 files based on Singapore District Code. We need to combine the rental data to form a complete rental dataset with 28 districts.]]> 2020-06-02 01:24:57 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/605947607 DISTRICT DATA balamuruganmarudhai https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606728379   Presenter: Rachel]]> 2020-06-02 12:10:29 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606728379 SALES DATA balamuruganmarudhai https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606729005   Presenter: Sunicha]]> 2020-06-02 12:10:51 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606729005 TASK 11 balamuruganmarudhai https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606747222 BLEND : Join Sales_Main with Rental_Main
ACTION : Using 'Left Outer Join' to add  column [Avg Monthly Gross Rent]  to Sales_Main. Matched [Project Name] to [Building/Project Name] and matched [Area Range (Sqft)] to [Floor Area (Sqft)].
REASON: Require data of value  [Avg Monthly Gross Rent]  for later action of cross table to summarize data with 'Ave Sales Price' and 'Avg Monthly Gross Rent'. ]]> 2020-06-02 12:22:05 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606747222 TASK 5 FarlinaAli007 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606829952 TRANSFORM: Summarized Rental Data by using cross table
ACTION: Visualization type - Cross Table, export data to file and proceed saving data as Rental_Main.txt
REASON: Transforming the required data using cross table visualization able us to obtain the average gross rent for the individual floor area in the project / building]]> 2020-06-02 13:11:37 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606829952 TASK 6 2080915h https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606832524 BLEND :  Stack Sales datasets 1 - 6 using Union
ACTION : Union sales data of all districts
REASON: The sales data from  URA, 28 districts, are split into 6 files based on Singapore District Code. Thus  combine sales data for all districts together  will provide clearer image for investor on making  decision.]]> 2020-06-02 13:13:04 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606832524 TASK 8 2080915h https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606838499 CLEAN: Clean column [No Of Units]
ACTION : Delete transactions with multiple units (>1)
REASON: Transactions with multiple units will result in wrong decision making]]> 2020-06-02 13:15:51 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606838499 TASK 9 2080844j1 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606851065 BLEND : Join Sales data & District data
ACTION : Left Outer Join (add column)
REASON : There are 28 districts in Singapore, and each district offers a different living experience.  Instead of the Districts number, the District name itself would be a better reference for both the property agent and the investor.]]> 2020-06-02 13:21:34 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606851065 TASK 10 2080844j1 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606855931 TRANSFORM : Add new column [Area Range (sqft)]
ACTION : Convert Area to Area Range (same as Rental Main)
REASON : The size of the property in the rental data is showing the Area range while the sales data is in a precise area. To have consistent data that is easy for comparison, we convert the Sales data to area range.

]]> 2020-06-02 13:23:55 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606855931 TASK 7 FarlinaAli007 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606861211 CLEAN: Change Date Format of column [Date Of Sale]
ACTION: Formatting change to MMM yyyy for all date Of Sale (column)
REASON:  All transactions under Date Of Sale (column) will be standardized showing 1st day of the month eg Dec 2009, Jan 2010 instead of different type of date format that might caused confusion.]]> 2020-06-02 13:26:31 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606861211 PUBLISH 2080701b1 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606928736                      Presenter: Lester / Francis
SALES_FINAL]]> 2020-06-02 13:59:17 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/606928736 CHALLENGES 2080701b1 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/614195841                                                                                                                                                       Presenter: Bala
1) URA datasets:
     - Website allows only 5 districts to be downloaded at one time
     - The URA dataset is generally quite clean
2) Synchronizing of tasks among team members
3) Use of conditional statements needed to convert Area to Area Range:
              CASE
                         WHEN X AND Y THEN A
              ELSE B
              END]]> 2020-06-06 12:48:03 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/614195841 TASK 4 2080637h https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/616809163 CLEAN: Clean column [No. Of Bedrooms]
ACTION: Delete rows with 'na'
REASON:  Data without no. of bedroom is not meaningful.]]> 2020-06-08 13:05:44 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/616809163 TASK 12 2080637h https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/616814654 TRANFORM: Summarize Sales Data
ACTION:: Summarize data with 'Avg Sales Price' and 'Avg Monthly Gross Rent'
REASON: To display the average sales price & average monthly gross rent by project by unit size (area) ]]> 2020-06-08 13:08:38 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/616814654 TASK 2 2080701b1 https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/625557525 CLEAN 1: Change the date format of [Lease Commencement Date]
ACTION: Change to 'MMM yy' format
REASON: The date was changed from 'MMM yy' to 'dd/mm/yyyy' after blending. In order for the data to be accurate and for easier reading, the date format will be changed to 'MMM yyyy' format.

CLEAN 2: Missing value in  [Lease Commencement Date]
ACTION : Change to "Jun-2019"
REASON: Rental prices generally increases over the months of the year. Hence, updating the missing data to 'Jun-2019' would statistically align the record to median position.]]> 2020-06-14 06:47:36 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/625557525 balamuruganmarudhai https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/625712596 2020-06-14 09:43:32 UTC https://padlet.com/balamuruganmarudhai/xfsf4wd9awg19sym/wish/625712596