/[pdpsoft]/nl.nikhef.pdp.fetchcrl/trunk/CHANGES
ViewVC logotype

Contents of /nl.nikhef.pdp.fetchcrl/trunk/CHANGES

Parent Directory Parent Directory | Revision Log Revision Log


Revision 2672 - (show annotations) (download)
Tue Sep 17 09:44:40 2013 UTC (8 years, 2 months ago) by davidg
File size: 16908 byte(s)
Write all CRLs with trailing newline

1 ==============================================================================
2 CHANGES to fetch-crl - the Certificate Revocation List retrieval tool
3 ==============================================================================
4 The fetch-crl utility will retrieve certificate revocation lists (CRLs) for
5 a set of installed trust anchors, based on crl_url files or IGTF-style info
6 files. It will install these for use with OpenSSL, NSS or third-party tools.
7
8 Changes in 3.0.12-1
9 ----------------------
10 * PEM formatted CRLs now always include a final newline character (fix
11 provided by Harald Barth <haba@kth.se>)
12
13 Changes in 3.0.11-1
14 ----------------------
15 * Added reference to /etc/fetch-crl.d/ to the man page, used shortened URL
16 to full documentation in man page
17 * Added version information to help output and added -V option
18 * Added a dangerous clean-crl script to remove stale .r* files (beware!)
19
20 Changes in 3.0.10-1
21 ----------------------
22 * Added a "noquiet" option in the configuration file that will override
23 the default single "-q" option in the cro-job that is shipped with
24 the fetch-crl3 init scripts (feature request by Ryan Taylor)
25 * Added option "--inet6glue" and "inet6glue" config setting to load
26 the Net::INET6Glue perl module (if it is available) to use IPv6
27 connections in LWP to download CRLs
28
29 Changes in 3.0.8-1
30 ----------------------
31 * Trust anchor name inferrence based on retrieved-CRL added as option (at cost
32 of retrieving CRL even if there is no accompanying trust anchor found later)
33 Option is disabled by default, but can be enabled by using @HASH@ in the
34 ca-template name list. (feature request by Rob van der Wal, SARA, NL)
35
36 Changes in 3.0.7-1
37 ----------------------
38 * CRL modofication time heuristic inadvertently modified file name templates
39 (solves issue kindly reported by Elan Ruusamae)
40 * Expanded representation of tokenisation characters in strings to work
41 around bug in file(1) (rhbz#699546, works around RedHat Bugzilla 699548)
42
43 Changes in 3.0.6-1
44 ----------------------
45 * Response parsing disabled to suppress superfluous warning on unexpected
46 UTF-8 respons when retrieving a CRL (solves RedHat Bugzilla 688902)
47
48 Changes in 3.0.5-1
49 ----------------------
50 * CRLs for multiple similarly-named trust anchors might not all be downloaded.
51 This is fixed in this release.
52 * Spurious "restoreLogMode" internal errors are no longer raised
53
54 Changes in 3.0.4-1
55 ----------------------
56 * Add support for directory based drop-in configuration in /etc/fetch-crl.d/
57 * Only use cached CRL contents if the nextUpdate time of the cached CRL is
58 still in the future. This will ensure that a new download is attempted
59 each and everytime for CRLs that have already expired.
60
61 Changes in 3.0.3-1
62 ----------------------
63 * Clean up of man page format macro PU (reported by Mattias Ellert)
64
65 Changes in 3.0.2-1
66 ----------------------
67 * Clean up of man page format macro PU (reported by Mattias Ellert)
68
69 Changes in 3.0.1-1
70 ----------------------
71 * hunts through more places to find the latest successful CRL download to
72 set the latest local modification time for a CRL
73 (resolves a comparison error in case output and infodir are unset)
74
75 Changes in 3.0.0-0.RC4
76 ----------------------
77 * the config file name has changed to fetch-crl.conf, although a
78 fetch-crl.cnf file will also be used when present
79 * symlinked meta-data files can be ignored with the --nosymlinks option
80 (or nosymlinks in the configuration file). This allows fetch-crl to be
81 used effectively with new-format IGTF distribution before 1.37
82 * infinite loop for non-indexed CA file names fixed
83
84 Changes in fetch-crl 3.0
85 ------------------------
86 * fetch-crl 3.0 is a complete re-write, and shares no code with the 1.x and
87 2.x series utility of the same name, although the function and some of
88 the syntax is obviously the same
89
90 * support for multiple output formats: OpenSSL 1 in dual-hash mode, specific
91 DER and PEM outputs, and NSS databases
92 * support for multiple CRLs for a single CA, allowing more than one CA with
93 the same subject name but different CLRs. Review your client software to see
94 if and how these CRLs are used.
95 * stateful retrieval helps reduce bandwidth usage by caching the CRLs locally
96 and respecting the Cache Control headers sent by the web server hosting the
97 CRL. This can reduce the number of downloads
98 * support for HEAD-only requests when state preservation is used (initially
99 only retrieve HTTP headers, and only if the CRL actually changed to a full
100 download)
101 * support for more CRL retrieval protocols (file:// and ftp://)
102 * ability to try site-local URLs first, before relying on the URLs shipped with
103 the trust anchor. This allows building an explicit local caching (web) server.
104 * ability to specify additional URLs to try in case the URLs shipped with the
105 trust anchor were not responsive. This allows for automatic fall-back to
106 (local or global) mirror services for CRL downloads
107 * warnings and errors can be suppressed on a per-trust anchor basis, to allow
108 silencing for particularly unstable trust anchors
109 * aging tolerance (the delay time before errors are generated in case downloads
110 consistently fail) can be configured on a per-trust anchor basis
111 * parallel downloading for multiple trust anchors
112 * minimized use of temporary files in the file system (now limited to the
113 invocation of OpenSSL only, and only for brief periods of time)
114 * dependencies on wget, lynx and other unix utilities have been removed
115 * explicit web proxy support (using LWP http proxies)
116 * completely re-written in perl, with some (hopefully minimal) dependencies:
117 LWP, Sys::Syslog, POSIX. And Data::Dumper (when debugging is enabled),
118 and IO::Select (if parallel downloads are enabled).
119
120 Differences with respect to the previous versions
121
122 * when downloading CRLs via https, the server certificate is not checked,
123 neither for the correct DNS name nor for being issued by a valid CA. Since
124 the CRL in itself is signed, this is not a security vulnerability. If
125 stricter checking is anyway desired, and the Crypt::SSLeay perl module has
126 been installed, set the HTTPS_CA_FILE environment variable before invoking
127 fetch-crl -- but keep in mind that the DNS name verification is limited
128 and will (incorrectly) reject DNS names if these are listed only in the
129 subjectAlternativeName of the server certificate
130 * Existing files with a name that matches a CRL target name are overwritten,
131 even if they did not originally contain CRL data. In v2 this was configurable
132 via the FORCE_OVERWRITE configuration setting. In version 3, files are
133 overwritten by default, and this can no longer be configured.
134 * fetch-crl3 will no longer check CA certificates for consistency or validity
135 by themselves, only retrieved CRLs are verified
136
137 Downsides of the new version
138
139 * it requires perl5 to be installed (tested with perl 5.8.0 and higher) with
140 libwww-perl, whereas version 2 only required a traditional Bourne shell
141 * requires a version of OpenSSL (0.9.5a or better) to be installed. Needs
142 OpenSSL 1.0.0 (at least beta5) for dual-hash support.
143 * when using parallel downloads, it can only run on pure-POSIX systems
144 * parallelism in combination with the NSS database output format is not tested
145 * Even when only the NSS database output format has been selected, OpenSSL is
146 still needed for verification and processing
147
148
149 ==============================================================================
150
151 The change log below applies to the 1.x and 2.x series fetch-crl and is
152 included for historical purposes only. Fetch-crl3, with which this
153 changes file is being shipped, is a complete re-write of the utility.
154 Although a lot of backwards compatibility has been preserves, there have
155 been significant changes and the information below should NOT be used
156 to infer any behaviour of fetch-crl3.
157
158 Fetch-crl 1.x and 2.x were released under the EU DataGrid License.
159
160 Changes in version EGP 2.8.5
161 ----------------------------
162 (2010.06.03)
163
164 * fetch-crl was occasionally leaving behind {hash}.r0.XXXXXX.r0 files
165 This has been fixed in this release (patch thanks to Jason Smith, BNL)
166 * man page was not compliant to Debian guidelines, this has been fixed
167 (patch thanks to Mattias Ellert, Uppsala University)
168
169 Changes in version EGP 2.8.4
170 ----------------------------
171 (2010.04.04)
172
173 * Fixes error when randomWait is not set [RH Bug 579488]
174
175 Changes in version EGP 2.8.3
176 ----------------------------
177 (2010.03.28)
178
179 * Preserve SELinux context for CRL files if SElinux status program exists
180 and selinux is enabled (RH bug 577403)
181 * Fix argument parsing on syslog facility specification (RH bug 577387)
182 * Increase granularity of the RandomWait and allow for 0 in -r option
183
184 Changes in version EGP 2.8.2
185 ----------------------------
186 (2010.03.03)
187
188 * Improved support for multiple CRL URLs by downloading until a success
189 is achieved, instead of downloading all of them
190 * Imported randomwait patch from Steve Traylen
191
192 Changes in version EGP 2.8.1
193 ----------------------------
194 (2010.01.26)
195
196 * The installed CRL file is re-checked for validity to catch file system
197 errors and local disk corruption. When possible, it will try to restore
198 a backup copy. Failures are not subject to aging tolerance.
199
200 Changes in version EGP 2.8.0
201 ----------------------------
202 (2009.09.22)
203
204 * The RPM packaging has been overhauled and is now sufficiently conformant
205 to EPEL and FedoraProject guidelines.
206 * New init scripts and a cron job entry have been added to allow management
207 of fetch-crl via the chkconfig mechanism
208
209 These changes were contributed by Steve Traylen (CERN, Geneva, CH).
210
211 Changes in version EGP 2.7.0
212 ----------------------------
213 (2009.01.25)
214
215 * Warnings and errors are now counted. If there are errors in the download
216 or verification process for one or more CRLs, the exit status will be 1;
217 if there are errors in the local setup or in the script invocation, the
218 exit status will be 2.
219 * The installed CRLs no longer have the textual representation of the CRL,
220 but only the PEM data blob, thus reducing IO and memory requirements.
221 * the CRL aging threshold is now set by default to 24 hours. The previous
222 default was 0. The CRL aging threshold is set in the config file using
223 CRL_AGING_THRESHOLD=<xx>, or with the "-a" command-line argument.
224 * Default network timeouts reduced to 10 seconds (was 30) and retries to 2
225 * Added caching and conditional downloading. When CACHEDIR is set, the
226 original downloads are preserved and wget timestamping mode enabled.
227 When the content did not change, only the timestamp on the installed
228 CRL is updated. If SLOPPYCRLHASHES is set, the has is calculated based
229 on the name of the crl_url file, otherwise it is taken from the CRL itself.
230 - The CACHEDIR must be exclusively writable by the user running fetch-crl
231 - Setting CACHEDIR significantly reduced the bandwidth used by fetch-crl
232 * Added RESETPATHMODE setting in sysconfig. It defines whether or not to
233 set re-set $PATH to "/bin:/usr/bin" before start. The search for OpenSSL
234 may be done based on the old path.
235 yes=always replace; searchopenssl=search for openssl first and then reset;
236 no=keep original path, whatever that me be (may be empty if called from cron)
237 Default="yes". This replaces the hard-coded path in the tool!
238 * Hidden "FORCE_OVERWRITE" option now has a regular name. This is backwards-
239 compatible. Set FORCE_OVERWRITE=yes if you want files overwritten that
240 have a CRL-like name and ought to have CRL content, but currently do not.
241 * Addresses gLite Savannah bugs 28418 and 29559. Bug 27023 is partially
242 addressed. Bug 20062 can be remedied with WGET_OPTS arguments.
243 Addresses OSG ticket 4673.
244
245 Changes in version EGP 2.6.6
246 ----------------------------
247 (2007.09.16)
248 (version 2.5.5 is invalid and was not publicly released)
249
250 * Added obscure configuration parameter to allow overwriting of
251 arbitrary data files with a downloaded CRL (on request of
252 CERN, see https://savannah.cern.ch/bugs/index.php?29559)
253
254 Changes in version EGP 2.6.4
255 ----------------------------
256 (2007.08.15)
257
258 * Expired CA issuer certificate now gives a warning instead of an error
259 with the full verification result message
260 * additional logfile output target can be selected via the configuration file
261 * CRL aging threshold documented in manual page. Errors will now also be
262 generated in the CRL download failed consistently and the current CRL
263 has already expired
264
265 Changes in version EGP 2.6.3
266 ----------------------------
267 (2006.11.13)
268
269 * cron job example: fetch-crl invocation syntax error corrected
270
271 Changes in version EGP 2.6.2
272 ----------------------------
273 (2006.10.27)
274
275 * fixed bug: older wget versions do not recognise --no-check-certificate
276
277 Changes in version EGP 2.6.1
278 ----------------------------
279 (2006.10.25)
280
281 * fixed local timezone vs UTC error in LastUpdate CRL validation comparison
282 * fixed time comparison is the one-hour LastUpdate/download tolerance
283 (both fixes thanks to Alain Roy)
284 * added support for directory names containing whitespace
285 * added support for syslog reporting (via -f option or SYSLOGFACILITY directive)
286 * SERVERCERTCHECK=no is now the default. It can be reset via the configuration
287 file, or using the "--check-server-certificate" commandline option
288 * the main configuration file location (formerly fixed to be
289 /etc/sysconfig/fetch-crl) can now be set via the variable $FETCH_CRL_SYSCONFIG
290 * logfile format timestamp and tag have been normalised
291
292 Changes in version EGP 2.6
293 --------------------------
294 (2006.05.20)
295
296 * if the current local CRL has a lastUpdate time in the future, and the
297 newly downloaded CRL is older that the current one, allow the installation
298 of the newly downloaded CRL and issue a warning.
299 * added non-suppressable warning in case the newly downloaded CRL has a
300 lastUpdate time in the future, but install that CRL anyway (as the local
301 clock might have been wrong).
302
303 Changes in version EGP 2.5
304 --------------------------
305 (2006.01.16)
306
307 * added additional configuration arguments and configuration variables
308 to skip the server certificate check in wget
309 (to support https:// URLs where the server is authenticated with
310 a certificate that is not part of it's own trusted domain, such as
311 the KISTI URL)
312
313 Changes in version EGP 2.4
314 --------------------------
315 (2005.11.15)
316
317 * for those platforms that support the stat(1) command, and in case the
318 .crl_url file is named after the hash of the crl subject name to download,
319 error eporting for individual download errors can be suppressed for
320 a configurable amount of time as set via the "-a" option (unit: hours).
321
322 Changes in version EGP 2.3
323 --------------------------
324 (2005.11.05)
325
326 * do not replace recent CRLs with ones that have an older lastUpdate
327 timestamp (prevents ARP/DNS DoS attacks)
328
329 Changes in version EGP 2.2
330 --------------------------
331 (2005.10.27)
332
333 * secure http download by wget recognise the CAs in the trusted directory.
334 solves the issue described in the LCG bug tracking system
335 https://savannah.cern.ch/bugs/index.php?func=detailitem&item_id=12182
336
337 Changes in version EGP 2.1
338 --------------------------
339 (2005.08.12)
340 * specifically look for the most recent version of OpenSSL. The
341 one in GLOBUS_LOCATION (which used to take precedence in the
342 previous releases) is outdated in many cases and caused
343 troubles on the LCG production systems in validating v2 CRLs
344 * added manual page fetch-crl(8)
345
346 Changes in version EGP 2.0
347 --------------------------
348 (2005.02.28)
349 * name of the installed script changed to "fetch-crl"
350 * the cronjob script is no longer installed by default, but supplied
351 as an example in the %doc directory
352 * RPM is now relocatable (default install in /usr)
353 * READMA and CHANGES file now inclued in %doc tree
354 * make install now installs
355 * version increased to 2.0
356
357 Changes in version EGP 1.9
358 --------------------------
359 (2005.02.24)
360 * the content of the final target CRL file is now checked for
361 containing a valid CRL if it already exists. If it does not
362 contain a CRL, an error is displayed and the file left untouched
363 So making the final ".r0" file in ${outdir} a link to something else
364 will not work, preventing an escalation in the final stage.
365
366 Changes in version EGP 1.8
367 --------------------------
368 (changes from Fabio's version 1.7, 2005.02.24)
369
370 * All temporary files (the initial CRL download using wget
371 and the PEM-converted version of that file) are now created using
372 mktemp
373 * the RetrieveFileByURL function will not overwrite files that
374 have any data in them
375 * Note that the script can be run by a non-priviledged user, but
376 that the output directory must be made writable by that user
377 in an out-of-band way.
378
379 EDG version 1.7
380 ---------------
381 Imported with consent of Fabio Hernandez and Steve Traylen from
382 the original EDG repository.
383 The EU DataGrid License applies, see http://www.eu-datagrid.org/

grid.support@nikhef.nl
ViewVC Help
Powered by ViewVC 1.1.28