Restrictions on geographic data in China
Due to national security concerns, the use of geographic information in China is restricted to entities that obtain a special authorization from the administrative department for surveying and mapping under the State Council.[1] Consequences of the restriction include fines for unauthorized surveys, lack of geotagging information on many cameras when the GPS chip detects a location within China, incorrect alignment of street maps with satellite maps in various applications,[2] and seeming unlawfulness of crowdsourced mapping efforts such as OpenStreetMap.
Legislation
According to articles 7, 26, 40 and 42 of the Surveying and Mapping Law of the People's Republic of China, private surveying and mapping activities have been illegal in mainland China since 2002. The law prohibits
publishing, without authorization, significant geographic information and data concerning the territorial air, land and waters, as well as other sea areas under the jurisdiction of the People's Republic of China.— The National Administration of Surveying, Mapping and Geoinformation of China, Surveying and Mapping Law of the People’s Republic of China
Fines range from 10,000 to 500,000 CNY (1606 – 80289 USD). Foreign individuals or organizations that wish to conduct surveying must form a Chinese-foreign joint venture.[1]
Between 2006 and 2011, the authorities pursued nearly 40 illegal cases of mapping and surveying.[3] The media has reported on other cases of unlawful surveys:
- 2007 7 March - Japanese and Korea scholars fined; joint-venture Weihai hired foreign surveyors without approval from the government[4]
- 2008 25 March - China's State Bureau of Surveying and Mapping cracks down on some of the 10,000 websites that publish maps in China, most without authorization[5]
- 2009 6 January - Chinese authorities fine UK students for “illegal map-making activities”[6]
- 2010 - Chinese authorities to crack down on the unregistered or illegal among 42,000 online map providers, targeting incorrect information and leaks of sensitive information involving State secrets. New standards require all Internet map providers to keep servers storing map data inside China.[7]
- 2014 14 March - Coca-Cola is accused of illegal mapping.[8]
As a consequence, major digital camera manufacturers including Panasonic, Leica, FujiFilm, Nikon and Samsung restrict location information within China.[9]
OpenStreetMap, the crowdsourced project to assemble a map of the world, advises that "private surveying and mapping activities are illegal in China".[10]
Coordinate systems
Chinese regulations mandate that approved map service providers in China use a specific coordinate system, called GCJ-02. Baidu Maps uses yet another coordinate system - BD-09,[11] which seems to be based on GCJ-02.[12]
GCJ-02
GCJ-02 (aka Mars Coordinates) is a geodetic datum formulated by the Chinese State Bureau of Surveying and Mapping, and based on WGS-84.[13] It uses an obfuscation algorithm[14] which adds apparently random offsets to both the latitude and longitude, with the alleged goal of improving national security.[12][15]
A marker with GCJ-02 coordinates will be displayed at the correct location on a GCJ-02 map. However, the offsets can result in a 100 - 700 meter error from the actual location if a WGS-84 marker (such as a GPS location) is placed on a GCJ-02 map, or vice versa. The Google.com street map is offset by 50–500 meters from reality,[8][16] while the Google.cn map is not.[17] Yahoo! Maps also displays the street map without major errors when compared to the satellite imagery.[18] MapQuest overlays OpenStreetMap data perfectly as well.[19]
Despite the secrecy surrounding the GCJ-02 obfuscation, several open-source projects exist that provide conversions between GCJ-02 and WGS-84, for languages including C#,[20] C, Go, Java, JavaScript, PHP,[21] Python,[22] R,[12] and Ruby.[23][24] They appear to be based on leaked code for the WGS to GCJ part.[25] Other solutions to the conversion involve interpolating coordinates based on regression from a data set of Google China and satellite imagery coordinates.[26] An attempt by Wu Yongzheng using FFT analysis gave a result much like the leaked code.[27]
From the leaked code,[20] GCJ-02 appears to use the SK-42 reference system, same as the system used by Beijing 1954.
BD-09
BD-09 is a geographic coordinate system used by Baidu Maps, adding further encryption to the already encrypted GCJ-02 "to better protect user's privacy".[28][29] Baidu provides an API call to convert from Google or GPS (WGS-84) coordinates into Baidu coordinates.[11] Similar to GCJ-02, there are no APIs to convert in the other direction, but open source implementations in R [12] and various other languages [21] exist.
Reverse transformation
GCJ-02 appears to use multiple high-frequency noises of the form , effectively generating a transcendental equation and thus eliminating analytical solutions. However, the open-source “reverse” transformations make use of the properties of GCJ-02 that the transformed coordinates are not too far from WGS-84 and are monotonic related to corresponding WGS-84 coordinates:[12]
def rev_transform_rough(bad: complex, worsen) -> complex:
"""
Roughly reverse the ``worsen`` transformation.
Since ``bad = worsen(good)`` is close to ``good``,
``worsen(bad) - bad`` can be used to approximate ``bad - good``.
First seen in eviltransform.
"""
return bad - (worsen(bad) - bad)
def rev_transform(bad: complex, worsen) -> complex:
"""
More precisely reverse the ``worsen`` transformation.
Similar to ``rev_transform_rough``,
``worsen(a) - worsen(b)`` can be used to approximate ``a - b``.
First seen in chinaGeo/R/cst.R.
"""
threshold = 1e-6
wgs = rev_transform_rough(bad, worsen)
old = bad
while abs(wgs - old) > threshold:
old = wgs
wgs -= bad - worsen(wgs)
return wgs
The rough method is reported to give some 1~2 meter accuracy for wgs2gcj,[21] while the exact method is able to get "centimeter accuracy" in two iterations.[30] Since the two properties ensure some basic functionality of the coordinate system, it's unlikely that the methods will change with new coordinate systems. The BD-to-GCJ code works in a manner much like the rough method, but removes the explicitly-applied constant shift of ~20 seconds of arc first.[12]
The China GPS shift problem
The China GPS shift (or offset) problem is a class of issues stemming from the difference between the GCJ-02 and WGS-84 datums. Global Positioning System coordinates are expressed using the WGS-84 standard and when plotted on street maps of China that follow the GCJ-02 coordinates, they appear off by a large (often over 500 meters) and variable amount. Authorized providers of location-based services and digital maps (such as AutoNavi or NavInfo) must purchase a "shift correction" algorithm that enables plotting GPS locations correctly on the map.[31] Satellite imagery and user-contributed street map data sets, such as those from OpenStreetMap also display correctly because they have been collected using GPS devices (albeit technically illegally - see Legislation).
Some map providers, such as Here, choose to also offset their satellite imagery layer to match the GCJ-02 street map.[32]
Google has worked with Chinese LBS provider AutoNavi since 2006 to source its maps in China.[33] google.cn/maps (formerly Google Ditu) uses the GCJ-02 system for both its street maps[34] and satellite imagery.[35] google.com/maps also uses GCJ-02 data for the street map, but doesn't shift the satellite imagery layer, which continues to use WGS-84 coordinates,[36] for reasons unknown. Google Earth also uses WGS-84 to display the satellite imagery.[37]
Overlaying GPS tracks on Google.com Maps and any street maps sourced from Google.com via its API, will lead to a similar display offset problem, because GPS tracks use WGS-84, and Google.com maps use GCJ-02. The issue has been reported numerous times on the Google Product Forums since 2009,[38] with 3rd party applications emerging to fix it.[39] Data sets with offsets for large lists of Chinese cities exist for sale.[40] The problem was observed as early as 2008, and the causes were unclear, with (misguided) speculation that imported GPS chips were tampered with code that caused incorrect reporting of coordinates.[41] It is still unclear whether GPS chips manufactured in China return GCJ-02 coordinates directly, or if they return WGS-84 coordinates, which approved map software can convert to GCJ-02.
Hong Kong and Macau
Under One Country Two Systems, legislation in mainland China does not apply in Hong Kong and Macau SARs and there are no similar restrictions in the SARs. Therefore, the GPS shift problem does not apply. However, at the border between the SARs and mainland China, the data shown by online maps are broken [42] when the shifted data and correct data overlaps. This poses problems to users travelling across the border, and is particularly confusing to visitors not aware of this problem.
References
- 1 2 "Surveying and Mapping Law of the People's Republic of China". National Administration of Surveying, Mapping and Geoinformation of China.
- ↑ Rabaza Bergua, Carlos S.; López-de-Larrínzar-Galdámez, Juan; Salvador Suárez, Iván; Usón Montesinos, Miguel; Muro Medrano, Pedro R. (13 November 2013). "Restricciones al trabajo con información geográfica online en China" (PDF). IV Jornadas Ibéricas de Infraestructuras de Datos Espaciales. Universidad de Castilla-La Mancha, Campus Tecnológico Fábrica de Armas, Toledo: JIIDE 2013.
- ↑ Hvistendahl, M. (24 January 2013). "Foreigners Run Afoul of China's Tightening Secrecy Rules". Science. 339 (6118): 384–385. doi:10.1126/science.339.6118.384.
- ↑ Dingding, Xin (7 March 2007). "Unlawful surveys to be dealt severely". China Daily.
- ↑ Liang, Yan (25 March 2008). "China cracks down on illegal online map services to protect state security". Beijing. Xinhua News Agency.
- ↑ "China fines UK students for 'illegal map-making'". AFP. 6 January 2009.
- ↑ Wang, Guanqun (19 May 2010). "China issues new rules on Internet map publishing". Xinhua News Agency.
- 1 2 Pasternack, Alex (14 March 2013). "If You're a Foreigner Using GPS in China, You Could Be a Spy". Vice (magazine).
- ↑ Doctorow, Cory (23 May 2015). "Why your camera's GPS won't work in China (maybe)". Boing Boing. Archived from the original on 24 May 2015.
- ↑ "Legality". Project China. OpenStreetMap. Retrieved 7 April 2015.
- 1 2 "Coordinate conversion" (in Chinese). Baidu Maps. Retrieved 7 April 2015.
- 1 2 3 4 5 6 "A package for geocoding, reverse geocoding and coordinate transformations between WGS-84, GCJ-02 and BD-09 coordinate systems". 15 February 2014.
- ↑ "Quickstart". Google Maps for AngularJS. Retrieved 7 April 2015.
- ↑ "手机地理轨迹取证步骤大解密". IT168.
- ↑ "国内常见的电子地图坐标介绍". 鲲鹏Web数据抓取.
- ↑ "Google.com hybrid map of The Bund". Retrieved 7 April 2015.
- ↑ "Google.cn map of The Bund". Google China.
- ↑ "Yahoo! Map of The Bund". Retrieved 7 April 2015.
- ↑ "MapQuest map of The Bund". Retrieved 7 April 2015.
- 1 2 "EvilTransform.cs". 2 February 2013.
- 1 2 3 Lee, Googol. "Transform coordinates between Earth (WGS-84) and Mars in China (GCJ-02)".
- ↑ "China GPS offset problem". SnapDragon Blog.
- ↑ "MarsGeo". Omniref.
- ↑ "EvilTransform Ruby gem".
- ↑ FENG, Zili (6 April 2015). "ChinaMapDeviation". Archived from the original on 7 April 2015.
- ↑ Guilbot, Maxime (28 May 2013). "ChinaMapDeviation".
- ↑ Wu, Yongzheng. "The Deviation of China Map as a Regression Problem". GitHub Pages. Retrieved 1 February 2016.
- ↑ Baidu LBS Open Platform FAQ
- ↑ "Coordinate Conversion API". developer.baidu.com/map (in Chinese). Baidu.
- ↑ bewantbe. "make gcj2wgs_exact() much faster, by using fixed…". GitHub. Retrieved 29 February 2016.
- ↑ Feng, Zili (7 April 2015). "The government charges Chinese companies for the "shift correction" feature".
- ↑ Monument to the People's Heroes. "Nokia Here street map and satellite map both use GCJ-02 coordinates". Retrieved 8 April 2015.
- ↑ Lee, Mark (6 July 2012). "Apple Shares Google China Map Partner in Win for AutoNavi: Tech". Bloomberg.
- ↑ Monument to the People's Heroes. "Google China street map uses GCJ-02 coordinates". Retrieved 8 April 2015.
- ↑ Monument to the People's Heroes. "Google China satellite imagery uses GCJ-02 coordinates". Retrieved 8 April 2015.
- ↑ Monument to the People's Heroes. "Google.com satellite imagery uses WGS-84 coordinates". Retrieved 8 April 2015.
- ↑ "Could you please correct the offset in China due to GCJ-02 coordinate?". Google Earth. Google Product Forums. 6 April 2014.
- ↑ "OFFSET MAPPING ISSUE IN CHINA". Google Product Forums. 5 March 2012.
- ↑ "ABCMaps application to fix the China GPS offset". 24 July 2010.
- ↑ Pasden, John (23 December 2014). "A More Complete iOS Solution to the China GPS Offset Problem".
- ↑ Wang, Jian Shuo. "All Maps in China are Transformed". Archived from the original on 16 January 2014.
- ↑ Google Maps near Hong Kong-Shenzhen border