Community price index (module price_index)
Script: scripts/modules/price_index.py (run from the project root; about 20 seconds).
Source: Dubai Land Department (DLD) open data via data.dubai (Dubai Open Data Licence): the sales
transactions table, the buildings register and the DLD project register, as staged in data/staging.duckdb
(see 00-staging.md). No other source is used. Data run to 2026-11-05; the latest complete month is
October 2026, and November 2026 is left out.
What it publishes
| File | Content |
|---|---|
data/out/price_index/community_index_monthly.{parquet,csv} |
community × type × area basis × market × month, Jan 2008 to Oct 2026 |
data/out/price_index/community_index_latest.{parquet,csv} |
the same for October 2026 only |
data/out/price_index/dubai_index_monthly.{parquet,csv} |
Dubai-wide series with an index (January 2008 = 100) |
data/out/price_index/community_map.{parquet,csv} |
how every DLD area / master project / project name was assigned to a community |
data/out/price_index/community_aliases.{parquet,csv} |
the hand-written alias and pattern lists used for the mapping |
data/out/price_index/area_labels.{parquet,csv} |
the name people use for each DLD area, taken from the community names (see "Area labels") |
site/data/price_index.json |
compact site data: Dubai series, latest table, monthly trend lines from Jan 2017, area labels, project communities and the period table of sales_market (community_period) |
Columns in the community and Dubai tables:
n_sales: the number of sales in the 3-month window after outlier removal. It is empty when fewer than 5.suppressed: true when the window has fewer than 5 sales. All statistics in the row are then empty.low_sample: true when the window is published but has fewer than 20 sales (5-19). The level is shown; the changes are not (seechg_*).median_aed_sqft: the 3-month median, in AED per sq ft, of the sales registered in the window ending inmonth(for example, the October 2026 row covers August, September and October 2026).p25_aed_sqft,p75_aed_sqft: the quartiles of the same sales after outlier removal.smoothed_aed_sqft: the smoothed level, which is the average of the 3-month medians formonth,month − 1andmonth − 2. It is empty unless all three are published.chg_1m_pct…chg_12m_pct: the percentage change of the smoothed level against 1, 3, 6, 9 and 12 months earlier. They are empty unless both ends are published and both windows hold at least 20 sales: in smaller cells the median moves by several percent on the mix of homes alone. For villas they are also empty when the cell is basis-sensitive (chg_basis_sensitive).chg_basis_sensitive(community tables and the site's latest table): true when the villa cell's changes were withheld because they depend on the area basis (see "Basis-sensitive villa changes"). Always false for apartments and for rows that had no published change.index_jan2008_100(Dubai table only): the smoothed level divided by its January 2008 value, × 100.
Sales included
From transactions (DLD dataset "Transactions"):
- The sales group only. Mortgages and gifts are excluded.
- Records must pass the staging quality flags (valid date, price ≥ AED 10,000, area 100–2,000,000 sq ft), and the price per sq ft must be between AED 100 and AED 50,000.
- Sale procedures counted as one home sold: Sell, Delayed Sell, Sell – Pre registration, Sale On Payment Plan, the Lease-to-Own registrations (including Delayed Lease to Own Registration), and the "Development" procedures (Sell Development, Delayed Sell Development, Development Registration, Delayed Development and their pre-registration forms). The Development procedures are sales of individual units in projects whose land is held under a development title, such as Dubai Silicon Oasis, Dubai Investments Park and Trade Centre. Their recorded areas are unit sizes, so they are included. Lease registrations and "Adding Land By Sell" are excluded.
- Type:
- Apartment means DLD property type Unit, sub-type Flat, with residential usage.
- Villa means DLD property type Villa with usage Residential, Commercial, Other or Multi-Use. Many freehold villas in Palm Jumeirah, Jumeirah Park, Emirates Living, Jumeirah Islands and Victory Heights are recorded with "Commercial" or "Other" land usage, and leaving them out would drop most of those communities. Industrial and agricultural usages are excluded. The few "Stacked Townhouses" units are also counted as Villa.
- DLD does not separate townhouses from villas, so Villa means all houses, townhouses included. No separate townhouse index is published, because no reliable townhouse flag exists in the open data.
- Houses registered on the plot: in many villa and townhouse communities DLD registers the sale of a house
with property type Land, the plot area and a title deed, also while the project is still being built (about
7,400 sales in the 12 months to October 2026, for example DAMAC Hills 2, DAMAC Lagoons, The Oasis and The Valley). These sales are
included as Villa. They are the
land_in_villa_projectsales of the enriched basis insales_market.md: Land sales in projects whose DLD buildings register is made of villas. Their built-up area comes from the buildings register (the house with the same plot size in the same project, else the project median), and their DLD-area basis is the plot. Bulk plot registrations are not house sales and are left out (rule insales_market.md, section (b)): a same-day batch of one project's Land records of which at least half have no buyer recorded, or that are parcels each holding several houses. October 2026 is the month most affected: 523 such records in Al Rowaiyah First would otherwise make that community's villa off-plan 3-month median USD 312 (AED 1,147) per sq ft on 716 sales, instead of USD 738 (AED 2,710) on 189 house sales, and the Dubai villa off-plan 3-month median on the DLD area USD 433 (AED 1,591) instead of USD 479 (AED 1,758). The headline Dubai villa series on the built-up area moves by less than 0.5% (off-plan 3-month median USD 411 (AED 1,508) instead of USD 412 (AED 1,512)). The rule also removes 672 records of 9 January 2025 in Al Yelayiss 1 (project cluster), which made up that community's whole January 2025 villa cell, at USD 45 (AED 164) per sq ft on the DLD area. - Market:
- Ready means DLD registration type "Existing Properties" (title deed), which mostly covers completed homes.
Ready is the headline market. A title deed does not always mean a finished home, so a house registered on its
plot counts as Ready only when its DLD project is FINISHED with a completion date on or before the sale date
(DLD projects register,
project_status). Otherwise it counts as Off-plan; a project that is newer than the projects register (a higher project number) is still being sold off-plan. The few plot-registered houses whose project is missing from the register (about 20 in the 12 months to October 2026) are counted in All only. - Off-plan means "Off-Plan Properties" (Oqood), plus the plot-registered houses described above.
- All means both together.
- Ready and off-plan homes are different products with different prices. The off-plan share of sales moves a lot over time (from almost none in 2008 to about three quarters of apartment sales in 2026), so a mixed median partly tracks that shift rather than prices. Reading the Ready series, or the Ready and Off-plan series separately, avoids this.
- Ready means DLD registration type "Existing Properties" (title deed), which mostly covers completed homes.
Ready is the headline market. A title deed does not always mean a finished home, so a house registered on its
plot counts as Ready only when its DLD project is FINISHED with a completion date on or before the sale date
(DLD projects register,
Community key
Commercial sites label areas with marketing community names. DLD provides area_name_en (the official
land area, for example "Marsa Dubai" or "Al Barsha South Fourth"), master_project (often the marketing
community, but with inconsistent spelling and missing for about 12–13% of sales in 2024–2026), project_name and
building_name. Each sale is assigned a community in this order:
- Project patterns: regular expressions on the project or building name, sometimes limited to one DLD area. For example, "Emirates Living – Springs N" becomes The Springs, "La Tilia / La Rosa / Amaranta" becomes Villanova, "Mira / Mira Oasis" becomes Reem, and the towers of The Views project group in DLD master project "The Greens" (Mosela, Panorama, Golf Towers, Fairways, Links, Una, Turia, Travo, Tanaro, Arno, Onyx) become The Views. The gated villa projects Grand Views, Millennium Estates and The Polo Townhouses in Nad Al Shiba First become Meydan, and Downtown Views I and II and Address Residences Zabeel in the Zaabeel areas become Downtown Dubai, where they are sold and listed (owner decision of 7 October 2026).
- Master-project aliases: DLD master project names mapped to common names. For example, "DMCC Master Community" becomes Jumeirah Lakes Towers, "International Media Production Zone" becomes Dubai Production City, "Dubai Land Residence Complex" becomes Dubai Residence Complex, "Arabian Ranches II" becomes Arabian Ranches 2, "Liwan1/2" becomes Liwan, and "DUBAI HILLS – …" becomes Dubai Hills Estate. Master projects not in the list keep their DLD name.
- Area aliases (only when the master project is empty): DLD area names mapped to common names. For example, Marsa Dubai becomes Dubai Marina, Burj Khalifa becomes Downtown Dubai, Al Barsha South Fourth becomes Jumeirah Village Circle, Al Barsha South Fifth becomes Jumeirah Village Triangle, and Al Thanyah First becomes Barsha Heights. Apartments in Um Suqaim Third become Madinat Jumeirah Living.
- Otherwise the DLD area name is used as is.
A community label is always an official DLD area or master-project name, a common place name, or a neutral label: a cluster of projects that has no DLD area or master-project name of its own is named after its DLD area with the suffix "(project cluster)" (for example Business Bay (project cluster), Al Yelayiss 1 (project cluster), Dubai Investment Park Second (project cluster)), never after a developer brand. The publication scanner flags any community label that starts with a developer brand and is not a DLD place name.
Every rule is in community_aliases.csv. The resulting assignment of each DLD area, master project and
project combination, with the number of sales it contributes, is in community_map.csv. Project names
are used only as location labels. The community key is built from location fields only. For projects whose
name carries a developer brand, community_map.csv keeps the row but leaves n_sales_used empty, so that
project-level sales cannot be summed by brand (00-publication-compliance.md, section 4).
Known limits of the mapping:
- Some marketing communities cannot be separated in DLD data. Most sales in Emirates Living that are not in The Springs carry no project name, so The Meadows and parts of Emirates Hills fall under Emirates Living (other).
- Most DAMAC Hills 2 and DAMAC Lagoons villa sales are plot registrations (type Land); they are in the index since the owner decision of 7 October 2026.
- Some names are judgement calls and are documented as such: Zabeel (the DLD Zaabeel First and Second areas outside DIFC, Dubai Design District, Downtown Views and Address Residences Zabeel; in practice One Za'abeel), Nad Al Sheba (DLD Nad Al Shiba areas outside Nad Al Sheba Gardens and Meydan; the Meydan gated villa projects named above are in Meydan) and Dubai World Central (the DLD master project, which includes Emaar South and Azizi Venice).
Area labels
DLD area names are legal names that buyers rarely use (Marsa Dubai, Al Barsha South Fourth). Every table and card of the site that shows a DLD area therefore shows the name people use, taken from the community names above; no new name is made up. Owner decision of 9 November 2026.
- Rule. For each DLD area the residential sales of the index (the same sales as above) in the last 24 complete months (November 2024 to October 2026 in this build) are counted by community. When one community holds at least 50% of them, the area is labelled with that community (Marsa Dubai → Dubai Marina, 66%; Al Barsha South Fourth → Jumeirah Village Circle, 100%; Burj Khalifa → Downtown Dubai). Otherwise, when the top two communities together hold at least 80%, the label is "A / B" (Al Thanyah Third → The Greens / The Views). Otherwise, or when the area had fewer than 30 such sales, the DLD name stays (Jabal Ali First, split between Discovery Gardens, Al Furjan and Wasl Gate). A label that is just the area's own "(project cluster)" or "(other)" group keeps the DLD name.
- Owner-named. Madinat Al Mataar is labelled Dubai South: the area holds the DLD master projects Dubai World Central and Dubai South Residential District, together known as Dubai South (the share rule alone would give Dubai World Central).
- Everyday names of established neighbourhoods (review of 9 November 2026). Recent off-plan launches dominate
the last 24 months of sales, so the share rule alone would name a whole established neighbourhood, and its whole
housing stock, after one new project (Al Satwa → Jumeirah Garden City, Al Wasl → City Walk, Jumeirah First →
La Mer, Um Suqaim Third → Madinat Jumeirah Living, Al Jadaf → Dubai Healthcare City Phase 2, Zaabeel First →
Downtown Dubai). These areas keep the DLD area name in its everyday spelling and numbering: Al Satwa, Al Wasl,
Al Jaddaf, Jumeirah 1–3, Umm Suqeim 1–3, Al Barsha 1–3, Trade Centre 1–2, Zabeel 1–2, Umm Hurair 2 and
Muhaisnah 1 (
methodcommon_name); numbered siblings get the same form, so two DLD areas never share one of these labels. Wadi Al Safa 4 is labelled City of Arabia. These labels apply whatever the number of sales (Um Hurair Second had 13). - Table
area_labels. One row per DLD area id (area_id,area_name_dld,label,top_share_pct,n_sales_24m,method).top_share_pctis the share of the area's sales in the label's community (both communities for "A / B"; the largest community when the DLD name stays; empty for the owner-named and everyday-name labels and below 30 sales);n_sales_24mis the number of sales counted (empty below 5).method:top_community,top_two_communities,mixed_dld_name,top_community_is_dld_area,owner_named,common_name,few_sales_dld_name(fewer than 30 sales),no_sales_dld_name(no residential sale in the 24 months; the DLD name stays). The label is computed per DLD area name, the key the site tables carry (Mushrif has two DLD area ids and one name). - Project communities. For the projects table and the project card the site prefers the project's own community:
the community of most (at least half) of the project's residential sales in all years (
project_communitiesin the site JSON, keyed by DLD project number). One DLD area can hold several communities, so this is more exact than the area label. Projects without such sales, or whose community is only the "(project cluster)" or "(other)" group of their area, fall back to the area label. A community that is itself a DLD area labelled after another community (Al Hebiah Fifth, labelled DAMAC Lagoons) holds that area's sales outside the named community: a site table shows it, or a project in it, under the DLD name with the hint "DLD area, outside DAMAC Lagoons" when the named community has its own rows in the same table, and otherwise under the people's label with the DLD name below. - Limits. A label describes most of an area's recent home sales, not all of it: housing stock and pipeline tables by area also include the parts of the area that sold little. Labels follow the sales and can change from one build to the next when an area's mix changes; close calls in this build are Al Merkadh → Meydan (50.2%) and Wadi Al Safa 7, whose own community holds 50.5% (the everyday and owner-named labels above are fixed).
Statistic
For each community, type, area basis, market and month M:
- Take every included sale registered in M−2, M−1 and M (a rolling 3-month window).
- Outlier removal (log-IQR rule): on the log of AED/sq ft in that window, take the first and third quartiles Q1 and Q3 and drop sales below Q1 − 1.5 × (Q3 − Q1) or above Q3 + 1.5 × (Q3 − Q1). The rule works at any window size: it removes a mis-keyed area or price in a window of 8 sales as well as in one of 800, and removes nothing when the prices are consistent.
- Median of the remaining AED/sq ft values. This is
median_aed_sqft, the 3-month median. - Suppression: if fewer than 5 sales remain, the count and all statistics are left empty.
- Smoothing:
smoothed_aed_sqft= the average of the 3-month medians of M, M−1 and M−2. This is a five-month span of sales in which the middle months count most (roughly a 1-2-3-2-1 weighting). It removes most month-to-month noise caused by changes in which homes sold. The cost is a lag: it reflects prices about two months before M. - Changes are computed on the smoothed level. For example,
chg_12m_pct= smoothed(M) / smoothed(M−12) − 1. A change is published only when the windows of both months hold at least 20 sales. Villa changes that depend on the area basis are withheld (see "Basis-sensitive villa changes").
The Dubai-wide series use the same steps over all communities together. Their index sets the smoothed level of January 2008 to 100 (that smoothed value covers sales from September 2007 to January 2008). Off-plan (Oqood) registration hardly existed before 2009, so the off-plan series have no January-2008 base and no index, only AED/sq ft.
Why these choices
- The median is used because prices per sq ft in DLD data are skewed and contain mis-keyed areas. The median is far less sensitive to these than a mean.
- Outlier rule: the median already ignores extreme values, so the rule changes levels very little. Variants tested (no trimming, 1/99, 5/95, 10/90 percentiles, and the 1.5×IQR rule on log prices) differed by fractions of a percent. Until 7 October 2026 the index used 5/95 percentile trimming; with discrete percentiles and ties kept it removed nothing below 20 sales and trimmed n = 20 on one side only, so it did not protect the small cells it was meant for. The log-IQR rule replaced it (owner decision of 7 October 2026).
- Small cells: cells with 5 to 19 sales are published with
low_sample = true(as in the rental index) and without changes. In the September 2026 build, cells of fewer than 10 sales had a median absolute 12-month change of about 8%, against about 6% for cells of 50 or more, much of it composition. In this build (latest month October 2026), 86 of the 180 published Ready cells (48%) are low-sample. - The pooled 3-month window and its smoothed level were chosen over a single month (too noisy where sales are few) and over a mean of monthly medians (that gives a month with 2 sales the same weight as a month with 200).
- Ready is the headline market for the reason given under Market above.
Villa area basis (estimate)
DLD records one area per sale (procedure_area). For apartments this is the unit area. For houses it
varies: many completed houses (for example Arabian Ranches, The Springs, Palm Jumeirah and Jumeirah Park)
carry the plot area, while many off-plan houses carry the built-up area (BUA). AED/sq ft of plot is
not comparable with AED/sq ft of BUA, and the mix of the two changes over time. Two villa series are
therefore published, marked by
area_basis:
DLD area: the recorded area, with no adjustment.-
Built-up area (est.): an estimate. The DLD buildings register lists every villa with its built-up area and its plot area (actual_area). The estimate is built as follows:- For each DLD project (or, when the project is not linked, each DLD area × master project) with at least 5 register entries, take the median BUA and the median plot.
- For each project and registration type (ready, off-plan), compare the median recorded sale area with those two values.
- If the sale area is closer to the plot, and the plot and BUA medians differ by more than 10%, convert the sale price per sq ft to a BUA basis: multiply by median plot / median BUA.
- Ratios outside 0.33–1.8 are treated as register inconsistencies and not applied.
- In all other cases the recorded area is kept.
The adjustment is project-level, not unit-level, so individual houses in a project with mixed plot sizes are converted with the project's typical ratio. The adjustment changes about three quarters of villa sales. Houses registered on the plot (type Land) do not use this ratio: each takes the built-up area of the register house with the same plot in the same project (else the project median), as estimated in
sales_market.
The Dubai-wide "All residential" and "Villas" series use the estimated BUA basis for villas. "Villas (DLD area)" is the unadjusted villa series.
Basis-sensitive villa changes
The two villa series usually move together, but a change can come from the area conversion rather than from prices. When the share of a community's sales whose DLD area is the plot changes between two months, the DLD-area median moves with that mix, and the built-up series is only as good as the project-level conversion ratio. Example (review of 9 November 2026): ready villas in Jumeirah Village Circle showed +45.0% over 12 months on the built-up basis and +5.8% on the DLD area. Between June–October 2025 and June–October 2026 the share of these sales converted from the plot fell from 78% (92 of 118) to 56% (42 of 75), while the median sale price barely moved (about USD 0.84M, AED 3.10M, against USD 0.82M, AED 3.00M).
- Rule. For each villa community × market × month, every horizon (1, 3, 6, 9 and 12 months) that has a published change on either basis is tested. The cell is basis-sensitive when, for at least one such horizon, the built-up and DLD-area changes differ by more than 20 percentage points. A test that lacks one of its two values does not fire.
- Plot-converted share (test switched off). The share of the cell's villa sales whose DLD area is the plot: sales
converted by the project ratio above, and houses registered on the plot (type Land). Like the smoothed level, it is
the mean of the shares in the 3-month windows ending in M, M − 1 and M − 2. A second test, this share moving by more
than 20 percentage points between month M and the earlier month, is in the script but switched off (owner decision
of 9 November 2026,
BASIS_MIX_PPset to infinity): on its own it withheld cells whose two bases agree (Town Square +5.5% / +1.4% and Arabian Ranches 3 All −0.2% / −5.4% over 12 months), and with it 19 cells would be withheld in this build instead of 12. - Effect. All changes of a basis-sensitive cell (1 to 12 months) are withheld on both bases, and
chg_basis_sensitiveis true. The 3-month median, the smoothed level and the trend line stay published. The rule is applied to every month ofcommunity_index_monthly, so the monthly and latest tables agree. It does not apply to apartments (one area basis) or to the Dubai-wide series. The threshold isBASIS_GAP_PPin the script. - This build (October 2026). 12 villa community × market cells (24 rows, both bases) lose their changes.
Villa rows with at least one published change go from 180 to 156, and published 12-month villa changes go from 152
to 128 (both bases counted). Across the monthly table since January 2008, the rule withholds the changes of 2,902 of
the 21,686 villa rows that had a published change (13%).
- Bases far apart: Jumeirah Village Circle Ready and All (12 months +45.0% / +5.8% and +37.2% / −1.2%, built-up / DLD area); Al Yufrah 1 Off-plan and All (+6.0% / +65.3%; all of its sales are on the plot, so here the DLD-area figure is the one that moves with the plot sizes sold); Wadi Al Safa 3 Off-plan and All (+27.8% / +53.0%); Jumeirah Golf Estates Ready (+18.1% / −3.6%); DAMAC Hills All (9 months +8.7% / −11.9%); Dubai Sports City Ready and All (9 months +18.1% / −4.4%); Grand Polo Club and Resort Off-plan and All (6 months +14.6% / −12.0%).
Caveats
- The median is not quality-adjusted. The median is not a repeat-sales or hedonic index. When the mix of what sells changes (new completions, a burst of sales in one tower, larger or smaller homes), the median moves even if no home changed value. This matters most in small communities and in off-plan series, where each new launch shifts the mix.
- 2008–2010. DLD registrations in these years include many contracts signed earlier at older prices, and Oqood registration only began in 2009. The early level is low and the series rises through 2009, when market prices actually fell. The January-2008 base is a reference point for the convention, not a measured market level. For long-run comparisons, start from 2012 or later.
- Cross-check against DLD's own index. DLD publishes a residential sale price index on data.dubai (monthly, March 2011 – May 2024 in the copy used here). Over March 2012 – May 2024, the 12-month changes of the Ready all-residential series correlate at about 0.7 with DLD's all-residential index, with a mean absolute difference of about 6 percentage points. The DLD index is a different method (it controls for property characteristics), so the two are not expected to match exactly.
- Villas include townhouses. The villa built-up-area series is an estimate, as described above. Villa changes
that depend on which area basis is used are not published (
chg_basis_sensitive). - Community labels are this project's own mapping and may not match any commercial site's definition of the same name.
- Rows link to communities, not to units. No unit numbers or unit-level rows are published.