Changelog

Bug in validate when reading products with a number of records > 4-byte range #533 [s.high]
Validate does not calculate overlaps correctly when Header is not first object in file #480 [s.medium]
NullPointerException when Table_Delimited is missing records attribute #473 [s.low]
Validate should not check PDF/A validity if content validation is disabled #453 [s.medium]
pds4.bundle option seems to not travel through enough subdirectories #444 [s.medium]
Build and unit tests do not pass on Windows OS #204 [s.low]
Fix uncaught exception error when validating an array object #155 [s.low]

v2.3.0 (2022-07-25)

Full Changelog

Requirements:

As a user, I want to receive an error when no products are found within the validation target #524
As a user, I want to validate labels/bundles/collections using the LBLX file extension #482
As a developer, I want an API method enable specifying of non-registered context products #241

Defects:

validate embedded in an app bundled as a fat-jar raise exception on product validation #516 [s.low]

Other closed issues:

Set registered context products in doValidation method #526
Improve Content Validation for PDF/A #497

v2.2.3 (2022-06-09)

Full Changelog

v2.2.2 (2022-06-08)

Full Changelog

v2.2.1 (2022-06-08)

Full Changelog

Defects:

validate having issues checking some file content on windows #507 [s.high]
validate passes confusing message to the command window #503 [s.high]
validate erroneously flags PDF/A-1a compliant file #479 [s.medium]

v2.2.0 (2022-04-07)

Full Changelog

Defects:

Fix validate compilation issues due to removal of veraPDF artifacts from maven central #470 [s.critical]
Validate content validation does not handle properly special_constants and field_statistics when they both appear #469 [s.medium]
Validate repo cannot be checked out on Windows without errors #411 [s.low]

v2.1.4 (2021-12-23)

Full Changelog

Defects:

Validate is reporting an "Uncaught exception while validating" error on Windows #464
[SECURITY] Patch log4j library #461 [s.critical]

v2.1.3 (2021-12-16)

Full Changelog

v2.1.2 (2021-12-10)

Full Changelog

Defects:

validate flags .ASC extension as invalid but offers not expected suffices #457

Other closed issues:

Update PDF/A documentation to include link to VeraPDF validation rules #454

v2.1.1 (2021-12-10)

Full Changelog

Requirements:

Improve PDF/A validation to include more robust reporting on failures #388
As a user, I want to check that all Internal References are valid references to other PDS4 products within the current validating bundle #308

Improvements:

Improve warning message for missing_context_reference #421
Update PDF validation to check against flavour specified in PDF metadata #412
Update rule documentation to remove "auto-detect" mention #377

Defects:

Validate does not correctly pass PDF/A files that are in a subdirectory #447 [s.high]
Validate is reporting a 'String index out of range' error for a text file #441 [s.high]
Incorrect Warning for Missing document_standard_id is Stream_Text #439 [s.medium]
Array Content Validator is not accepting values at the min/max due to false precision #435 [s.medium]
validate warns "document standard id ... is not correct" on good labels #429 [s.high]
Validate does not allow SIP tab file to have lines of differing lengths #424 [s.medium]
Validate does not allow a single-character subdirectory #423 [s.medium]
validate 2.2.0-SNAPSHOT warns about a pretty benign bundle + readme.txt #419 [s.medium]
validate 2.1.0 indicates the table offset is not correct when validating a binary table inside a FITS #416 [s.critical]
Validate 2.1.0-SNAPSHOT skips a collection XML label #408 [s.medium]
Checksums output lowercase and do not accept uppercase checksums #376 [s.low]
validate allows absolute path in directory_path_name but shouldn't #349 [s.medium]

v2.1.0 (2021-10-05)

Full Changelog

Requirements:

As a user, I want to validate all files referenced by a Product_Document #367

Improvements:

Refactor PDF/A check handling to match with similar product checks #374
Update pds4 version mismatch warning message and problem type #373
Improve validate performance by removing unnecessary file IO #358

Defects:

validate does not flag <CR> within lid_reference #401 [s.medium]
Validate throws incorrect overlap error when first Field_Bit has length 1 #392 [s.medium]
validate does not work correctly when the path name contains a space #381 [s.medium]
stack trace being created during successful validate execution #380 [s.high]
FileService:printStackTraceToFile:ERROR when validating a product with overlapping fields #379
validate raises an unexpected error with doi attribute in the Citation_information class #378
validate halts if label has name "collection" embedded #375 [s.medium]
Issues with logic for reading latest version of collections, and file read logging lost with v2.* of validate #372 [s.medium]
Product referential integrity check throws invalid WARNINGs #368 [s.medium]
validate should not check if file is PDF/A if --skip-content-validation is enabled #366 [s.low]
validate does not check Header of a File_Area_Ancillary nor does not provide a meaningful error message for an incorrect Table_Character offset #361 [s.medium]
validate does not parse colon in Windows path #360 [s.high]

v2.0.7 (2021-07-03)

Full Changelog

Improvements:

Improve validate reporting when trying to read a null row #355

Defects:

validate does not allow ".XML" as an extension for a label file #364 [s.medium]
Validate allows CRLF within a Table_Delimited field #357 [s.medium]
validate labels error.sub_directory.unallowed_name as a warning #356 [s.low]

v2.0.6 (2021-05-25)

Full Changelog

Defects:

validate incorrectly flags integers bounded by "" in a .csv #345 [s.medium]

v2.0.5 (2021-05-20)

Full Changelog

Defects:

validate inexplicably writes to validate_stack_traces.log #344 [s.low]

v2.0.4 (2021-05-11)

Full Changelog

Defects:

Validate fails with Java Error #337 [s.high]
validate2.0.3 throws unexpected JavaExceptions, and after fix, it hangs when trying bundle validation #336 [s.medium]
validate gives a NullPointerException during validation of a directory containing Table_Character products #335 [s.medium]
validate 2.1.0 snapshot fails on a label with 2 table_character #334 [s.medium]
validate -u exits badly #333
validate bundle incorrectly reports "not a member of any collection" that it passed before #328 [s.medium]
validate fails to process large data file #327 [s.medium]
File-size check fails for large data files #326 [s.medium]
Validate Incorrectly Throws Error When Embedded Field_Character Contains <CR><LF> #325 [s.medium]

v2.0.3 (2021-05-03)

Full Changelog

Requirements:

As a user, I want to the raise a WARNING if the object-defined size in the label does not match the file_size value #303
As a user, I want to validate PDF files are PDF/A #164
As a user, I want to be warned when there are alphanumeric characters between fields in Table_Character #57

v2.0.2 (2021-04-08)

Full Changelog

Improvements:

Upgrade to Java 9+ #323
Update installation documentation to require Java 1.9+ #322

v2.0.0 (2021-04-06)

Full Changelog

Requirements:

CCB-264: Make the Line Feed (LF) character an allowed record delimiter #292
As a user, I want validate to raise a WARNING when differing versions of IM are used within a bundle #210
As a user, I want to validate a bundle that uses multiple versions of the Information Model / Discipline LDDs #188

Improvements:

Migrate subset of existing regression tests to cucumber behavioral testing #290
Update installation documentation to include 64-bit Java as system requirement #264
validate does not perform expediently when doing bundle-level validation against large bundles #254
Implement initial behavioral testing framework with cucumber #252
Add output directory flag to validate-bundle tool #246
validate does not perform full bundle validation when using a specific bundle.xml #238
Update validate per SR requirements for collection inventories #230
Validate and throw error when duplicate LIDs are found in Bundle #81
Provide the capability to specify multiple locations for pds4.bundle validation #51
Validate schematron references and throw fatal error if invalid URI specified #17

Defects:

Validate missing collections in bundle after CCB-282 updates #310 [s.medium]
unclear error message for field count matching #301 [s.medium]
validate -u flag reports an error on Windows #300 [s.medium]
Validate tool does not PASS a bundle with a single-character filename #299 [s.low]
validate misses double quotes within a delimited table #298 [s.medium]
Content validation of ASCII_Integer field does not accept value with leading zeroes #297 [s.medium]
Content validation incorrectly reports error for floating-point values out of specified min/max range #294 [s.medium]
When validating a product with a bad schematron definition, bundle validation also fails indicating the associated product does not exist #291 [s.low]
Validate fails to report error in File.file_size #281 [s.medium]
Registered context products file does not retain older versions of context products #278 [s.medium]
Bug performing bundle validation with nested directories #273 [s.medium]
validate 1.25.0-SNAPSHOT raises an exception when validating a product #271 [s.low]
Missing documentation about deprecated flags #260 [s.low]
Product with incorrect table binary definition pass validation #257 [s.medium]
validate should only do integrity checking on latest version of a collection when referenced by LID #256
Unexpected error for data collection in a sub-directory #240 [s.medium]
Validate error reading tables > 2GiB #189
Update validate to throw error when a file has a space in the filename #153 [s.medium]
Update allowable field_format values per Standards Reference definition regarding [+|-] characters #11 [s.low]
Improve pds4.bundle unlabeled files check to handle files without a file suffix #6 [s.medium]
Improve file base name check according to Standards Reference #5 [s.low]

Other closed issues:

Implement initial test to exercise framework #283
Implement initial framework to be able to start developing tests #282
Retrofit validate CI to use roundup-action #255

1.24.0 (2020-09-09)

Full Changelog

1.23.3 (2020-08-06)

Full Changelog

Defects:

validate 1.24.0-SNAPSHOT chokes on a probably good file #243

1.23.2 (2020-08-04)

Full Changelog

Defects:

Validate gives incorrect records mismatch WARNING for interleaved data objects #234
Product validation does not detect the number of table records correctly for Table + Array object #233

v1.23.1 (2020-05-16)

Full Changelog

Defects:

Incorrect validation of number of records #220
Packed_Data_Fields and bit fields do not validate as expected #209

v1.23.0 (2020-05-08)

Full Changelog

Improvements:

Reduce error messages for overlapping fields #222
Throw warning when data exists after number of records #215

Defects:

validate v1.22.3 has large performance degradation on products with many tables #219
Software raises a field_value_overlap error on Table_Binary Packed data fields #177

v1.22.4 (2020-05-01)

Full Changelog

v1.22.3 (2020-04-18)

Full Changelog

Requirements:

As a user, I want validate to check number of records/fields specified in label matches the records in the actual data table #149

v1.22.2 (2020-04-11)

Full Changelog

Requirements:

Validate Table_Character groups and their specified lengths match the specified group_length #63

Defects:

validate outputs an extra '.' #214
Validate incorrectly fails ASCII_Integer field that is space-padded (empty) in Table_Character #206
Assembly plugin non-fatal errors on Windows #203
Schematron doesn't fire if <?xml-model ...> has an extra space at the end #201

v1.22.1 (2020-03-28)

Full Changelog

v1.22.0 (2020-03-28)

Full Changelog

Improvements:

Change behaviour for printing of "dots" to show progress #197
Improve installation procedure #195
Update validate-bundle to include report filepath flag #194
Update documentation to include more details about how/where to file bug reports #187
Upgrade to Saxon 9.9.1-7 to fix Schematron bug #182
Add validated product counter to pass/fail reporting and end summary #132

Defects:

Fix schematron parsing bug introduced during performance improvements #175

Other closed issues:

CCB-282: Revert validation checks on strict file naming requirements #192

v1.21.0 (2020-03-11)

Full Changelog

Improvements:

Develop validate-bundle script for Validation performance improvements using parallelization approach #128

Other closed issues:

Document new test case for I&T and deliver to I&T engineer #130
Document new performance benchmarks #129
Enhance validate performance to average <1 second with content validation enabled #123

v1.20.0 (2020-02-03)

Full Changelog

Defects:

Memory leak issue has returned after Saxon downgrade #183

v1.19.0 (2020-01-31)

Full Changelog

Defects:

Fix multi-threading bug where reporting finishes prior to threads completing execution #180
Improve performance when content validation is disabled #178

v1.18.2 (2020-01-22)

Full Changelog

Defects:

Bug with #149 fix: Product counter is invalid and does not reset after each collection #173

v1.18.1 (2020-01-21)

Full Changelog

v1.18.0 (2020-01-21)

Full Changelog

Improvements:

Update POM to use PDS Parent POM #158
L5.PRP.VA.42 The tool shall average less than 1 second execution time when content validation is disabled. #124
Validate that Table_Character/Table_Binary fields match the field length definitions in the label #56

Defects:

Update validate to allow for empty fields in delimited tables #170
Content validation multi-threading issue #167
Spot check bug throws internal_error when record number is multiple of spot check number #165
Remove erroneous timing messages from log output #160
Fix string == comparison issues per vulnerability scan #144

Other closed issues:

Introduce label and array timing metrics logging #156
Document new test case for I&T and delivery to I&T engineer #127
Document new performance benchmarks #126
Implement validation performance improvements #125

v1.17.5 (2019-10-25)

Full Changelog

Defects:

Suppress INFO messages related to initial fix for JAXB vulnerability #2

v1.17.4 (2019-10-22)

Full Changelog

Defects:

Update parent LID integrity checking to fix bug introduced for collection integrity checking #146
Incorrect help information for --spot-check-data flag #145

Other closed issues:

Validate operational release for Build 10a #106

v1.17.3 (2019-10-16)

Full Changelog

Defects:

Revisit PDS-605: L5.PRP.VA.36: Check that the LID for a product has the LID of its parent collection product as its base #139

v1.17.2 (2019-10-16)

Full Changelog

Defects:

Update delimited table handling to allow for empty fields #137

v1.17.1 (2019-10-15)

Full Changelog

Improvements:

Update config to include telescopes and facilities telescopes and facilities #135

v1.17.0 (2019-10-15)

Full Changelog

Requirements:

Add new target-manifest flag for user to provide a manifest (file) of file/directory paths to validate #50
Verify that all name/type attribute values correspond to names denoted context products #15

Improvements:

Deprecate --no-data-check to --skip-content-validation to fall in line with other argument naming #133
Update context checks to include data_to_investigation #90
Update validate to apply catalog file and local schemas to discipline schema resolution #87
Add flag to temporarily disable context validation #47
Document multi-threaded architecture for maximized performance #43
Perform benchmarking on validate to enable documenting of system requirements #41
Enhance content validation to decrease validation time to <=50% of current benchmark #30
Improve pds4.bundle validation performance #29
Improve documentation about usage of flags in config file with latest flags #20

Defects:

Update Validate error/warning counts per ATM regression testing #118
Registered context product resource lists only one of multiple instrument or target multiple types #107
Fix bug introduce by --skip-context-validation feature #99
Update Validate to allow specification of schema/schematrons in config file #84
Context validation needs to be updated to include all possible product type use cases #62
Update content validation to fail when the value of an ASCII_Integer is all spaces #9
Large Data File Uncaught Exception Error #8
JAXB warning message with Java 9+ #3

Other closed issues:

Revert name/type checks from context validation until discussed with TWG #120
Validate release candidate for Build 10a #105
Update context name check to throw WARNING instead of ERROR #102
Create new "error message decoder ring" for common validate issues and how to solve them #97
Update validate to apply catalogs/schemas used as input across all ingested schemas #86
Test and document benchmark metrics from improved content validation #80
Implement content validation performance improvements #79
Investigate and determine potential content validation performance improvements #78
Check that referenced context products are valid #45

v1.15.3 (2019-08-20)

Full Changelog

Defects:

Validate execution script throws arguments error with v1.15.1 #74

v1.15.2 (2019-08-19)

Full Changelog

Improvements:

Complete engineering point build 1.15.1 #64
Add capability to pds4.bundle validation to ignore product-level validation #42

Defects:

Catalog file flag expects a List of files requiring it not be the last argument #72
Unable to use catalog file after update to always force remote schemas #71

Other closed issues:

Update pom to exclude additional SLF4J bindings #70

v1.15.1 (2019-08-08)

Full Changelog

Improvements:

Update Maven docs to refer to Github release assets #65
Investigate and fix memory leak causing validate crash on large bundles #39
Prepare repository for Maven Central deployment #31
Add capability for user to input JSON file with additional context products #28
Update build per pds4-tools rename and open source #26
Update context check to retrieve and use latest context products from EN Registry #24
Deprecate -f and -m flags #23
Update pom and readme to reference public docs #21
Remove references to PDS Maven Repo and update packages to build without it #19

Defects:

Content validation does not work properly #55
Incorrect package declarations under gov.nasa.tools.web.ui #52
JAVA Path does not handle whitespaces in MAC as it used to #37
Add missing core.properties dependency #34
Validation succeeds despite throwing exception #33

* This Changelog was automatically generated by github_changelog_generator

Files

CHANGELOG.md

Latest commit

History

CHANGELOG.md

File metadata and controls

Changelog

«unknown» (2022-12-05)

v3.1.0-SNAPSHOT (2022-12-02)

v3.0.3 (2022-11-10)

v3.0.2 (2022-11-08)

v3.0.0 (2022-11-02)

v2.4.0 (2022-11-01)

v2.3.0 (2022-07-25)

v2.2.3 (2022-06-09)

v2.2.2 (2022-06-08)

v2.2.1 (2022-06-08)

v2.2.0 (2022-04-07)

v2.1.4 (2021-12-23)

v2.1.3 (2021-12-16)

v2.1.2 (2021-12-10)

v2.1.1 (2021-12-10)

v2.1.0 (2021-10-05)

v2.0.7 (2021-07-03)

v2.0.6 (2021-05-25)

v2.0.5 (2021-05-20)

v2.0.4 (2021-05-11)

v2.0.3 (2021-05-03)

v2.0.2 (2021-04-08)

v2.0.0 (2021-04-06)

1.24.0 (2020-09-09)

1.23.3 (2020-08-06)

1.23.2 (2020-08-04)

v1.23.1 (2020-05-16)

v1.23.0 (2020-05-08)

v1.22.4 (2020-05-01)

v1.22.3 (2020-04-18)

v1.22.2 (2020-04-11)

v1.22.1 (2020-03-28)

v1.22.0 (2020-03-28)

v1.21.0 (2020-03-11)

v1.20.0 (2020-02-03)

v1.19.0 (2020-01-31)

v1.18.2 (2020-01-22)

v1.18.1 (2020-01-21)

v1.18.0 (2020-01-21)

v1.17.5 (2019-10-25)

v1.17.4 (2019-10-22)

v1.17.3 (2019-10-16)

v1.17.2 (2019-10-16)

v1.17.1 (2019-10-15)

v1.17.0 (2019-10-15)

v1.15.3 (2019-08-20)

v1.15.2 (2019-08-19)

v1.15.1 (2019-08-08)