[SQM] version 0.1.5 of the proposed community standard light at night data format

Christopher Kyba christopher.kyba at wew.fu-berlin.de
Sat Jul 7 14:16:28 UTC 2012


Hello all,

We have made several changes to the format based on input from some
database experts and others.  We have also agreed to a request to
declare the official adoption of the format at the 12th European
Symposium for the Protection of the Night Sky on September 15.  This
will also allow individual astronomers at the IAU meeting in Beijing a
chance to endorse the format before it goes "live".  I hate to have to
shout, but IF YOU HAVE ANY COMMENTS OR OBJECTIONS TO THIS FORMAT LET
ME KNOW NOW!  We cannot allow this to slide indefinitely, so if you
don't give me your input immediately it will soon be too late.

The major changes since the last version I posted online are listed below:

1) Times are now reported using a version of ISO 8601.  Specifically,
they are to be reported as: YYYY-MM-DDTHH:MM:SS.FFF

2) The -9999 and -9998 values have been replaced.  The argument was
that a parser may see these as valid entries and not throw an
objection.  The new standard is that the entry does not apply for some
reason then "n/a" (in lowercase) should be written out.  If there is
no data, or if the data is known to be corrupted, then the entry
should be left blank.

3) The header specifies the URL at which you can find the definition
of the format.

4) I have included an example file for GLOBE at Night data.  I think
that having both SQM and NELM data in the same file introduces a bunch
of problems though, so if it works for them I think that we should
probably ask GLOBE at Night to write two files, one for SQM data and
one for visual observations.

5) We recommend a readout frequency in the range of once per 1-10
seconds, with an absolute minimum readout frequency of one observation
per minute (for stationary, line powered stations).  This is important
for getting statistics on the range of values that are observed under
partly cloudy skies.

Best wishes,

Christopher Kyba
Institute for Space Sciences
Freie Universität Berlin
http://userpage.fu-berlin.de/~kyba/
-------------- next part --------------
# Light Pollution Monitoring Data Format 0.1.5
# URL: http://www.darksky.org/LANstandards/clan_format_0.1.5.pdf
# Number of header lines: 35
# This data is released under the following license: ODbL 1.0 http://opendatacommons.org/licenses/odbl/summary/
# Device type: IYA Lightmeter (Mark 2.3)
# Instrument ID: DE_BERLIN_4
# Data supplier: Christopher Kyba / Freie Universitaet Berlin
# Location name: Berlin-Dahlem
# Position: 52.4577, 13.3107, 91
# Local timezone: Europe/Berlin
# Time Synchronization: NTP
# Moving / Stationary position: STATIONARY
# Moving / Fixed look direction: FIXED
# Number of channels: 1
# Filter per channel: None
# Measurement direction per channel: 0., 0.
# Field of view: 180
# Number of fields per line: 4
# IYAL serial number: n/a
# IYAL firmware version: n/a
# IYAL readout test: 23.3.2012;15:24:58;27,6;°C;2984760;0;0;ok;
# Comment: The shadow of our building falls on the lightmeter around noon
# Comment: contact: christopher.kyba at wew.fu-berlin.de
# Comment: 
# Comment: 
# Comment: 
# blank line 27
# blank line 28
# blank line 29
# blank line 30
# blank line 31
# blank line 32
# UTC Date & Time, Local Date & Time, Temperature, Counts
# YYYY-MM-DDTHH:mm:ss.fff YYYY-MM-DDTHH:mm:ss.fff Celsius number
# END OF HEADER
2012-03-23T15:24:59.000 2012-03-23T16:24:59.000 27.5 2984520
2012-03-23T15:25:01.000 2012-03-23T16:25:01.000 27.5 2984640
2012-03-23T15:25:02.000 2012-03-23T16:25:02.000 27.5 2984280
2012-03-23T15:25:03.000 2012-03-23T16:25:03.000 27.6 2984520
2012-03-23T15:25:04.000 2012-03-23T16:25:04.000 27.5 2984760
2012-03-23T15:25:05.000 2012-03-23T16:25:05.000 27.6 2984640
2012-03-23T15:25:06.000 2012-03-23T16:25:06.000 27.6 2984760
2012-03-23T15:25:07.000 2012-03-23T16:25:07.000 27.5 2984760
2012-03-23T15:25:08.000 2012-03-23T16:25:08.000 27.5 2985000
2012-03-23T15:25:09.000 2012-03-23T16:25:09.000 27.5 2984880
2012-03-23T15:25:10.000 2012-03-23T16:25:10.000 27.5 2984880
2012-03-23T15:25:11.000 2012-03-23T16:25:11.000 27.6 2984760
-------------- next part --------------
# Light Pollution Monitoring Data Format 0.1.5
# URL: http://www.darksky.org/LANstandards/clan_format_0.1.5.pdf
# Number of header lines: 35
# This data is released under the following license: ODbL 1.0 http://opendatacommons.org/licenses/odbl/summary/
# Device type: SQM-LE
# Instrument ID: Dahlem_tower_le
# Data supplier: Christopher Kyba / Freie Universitaet Berlin
# Location name: Berlin-Dahlem
# Position: 52.4577, 13.3107, 91
# Local timezone: Europe/Berlin
# Time Synchronization: GPS
# Moving / Stationary position: STATIONARY
# Moving / Fixed look direction: FIXED
# Number of channels: 1
# Filters per channel: HOYA CM-500
# Measurement direction per channel: 0., 0.
# Field of view: 20
# Number of fields per line: 6
# SQM serial number: 1687
# SQM firmware version: 4-3-21
# SQM cover offset value: -0.11
# SQM readout test ix: i,00000004,00000003,00000021,00001687
# SQM readout test rx: r, 18.73m,0000000004Hz,0000130978c,0000000.284s, 031.2C
# SQM readout test cx: c,00000019.69m, 0000300.000s, 023.2C,00000008.71m, 029.3C
# Comment: SQM installed on a tower.
# Comment: last cleaned on 20120511
# Comment: 
# Comment: 
# Comment: 
# blank line 30
# blank line 31
# blank line 32
# UTC Date & Time, Local Date & Time, Temperature, Counts, Frequency, MSAS
# YYYY-MM-DDTHH:mm:ss.fff;YYYY-MM-DDTHH:mm:ss.fff;Celsius;number;Hz;mag/arcsec^2
# END OF HEADER
2012-05-11T00:00:04.000;2012-05-11T00:00:04.000;31.2;130978;4;18.73
2012-05-11T00:00:09.000;2012-05-11T00:00:09.000;31.2;130978;4;18.73
2012-05-11T00:00:14.000;2012-05-11T00:00:14.000;31.2;130978;4;18.73
2012-05-11T00:00:19.000;2012-05-11T00:00:19.000;31.2;130978;4;18.73
2012-05-11T00:00:24.000;2012-05-11T00:00:24.000;31.2;130978;4;18.73
2012-05-11T00:00:29.000;2012-05-11T00:00:29.000;31.2;130978;4;18.73
-------------- next part --------------
# Light Pollution Monitoring Data Format 0.1.5
# URL: http://www.darksky.org/LANstandards/clan_format_0.1.5.pdf
# Number of header lines: 35
# This data is released under the following license: ODbL 1.0 http://opendatacommons.org/licenses/odbl/summary/
# Device type: human eye
# Instrument ID: n/a
# Data supplier: GLOBE at Night
# Location name: n/a
# Position: Included in data
# Local timezone: n/a
# Time Synchronization: n/a
# Moving / Stationary position: MOVING
# Moving / Fixed look direction: MOVING
# Number of channels: 1
# Filters per channel: n/a
# Measurement direction per channel: Included in data
# Field of view: n/a
# Number of fields per line: 15
# Comment: Official GLOBE at Night dataset for 2011
# Comment: 
# Comment: 
# Comment: 
# Comment: 
# blank line 24
# blank line 25
# blank line 26
# blank line 27
# blank line 28
# blank line 29
# blank line 30
# blank line 31
# blank line 32
# UTC Date & Time, Local Date & Time, ObsID, Latitude, Longitude, NELM, SQM Reading, SQM Serial, Cloud Cover, Dirn Zenith, Dirn Azimuth Constellation, Country, Sky Comment, Location Comment
# YYYY-MM-DDTHH:mm:ss.fff;YYYY-MM-DDTHH:mm:ss.fff;degrees;degrees;NELM;mag/arcsec^2;number;okta;degrees;degrees;text;text;text;text
# END OF HEADER
2011-02-21T20:00:00.000;2013-02-21T17:00:00.000;1;47.9327;21.0382;3;n/a;n/a;2;75.45;202.20;Orion;Hungary;;
2011-02-22T02:04:00.000;2011-02-21T21:04:00.000;2;27.5072;-109.934;4;n/a;n/a;0;75.45;202.20;Orion;Mexico;No clouds;One porchlight
2011-02-21T19:10:00.000;2011-02-21T20:10:00.000;44;52.0287;8.36865;20.02;4783;0;75.45;202.20;Orion;Germany;A light dome from a city in the east.;Slight haze.,rural
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sdf0.1.5.pdf
Type: application/pdf
Size: 112296 bytes
Desc: not available
Url : http://unihedron.com/pipermail/sqm/attachments/20120707/db940d1f/attachment-0001.pdf 


More information about the sqm mailing list