Updated the documentation of ResampleFunction in the BootstrapMethodTable of Bootstrap(). Specifically the pros and cons of ResampleFunction “ResampleBioticAssignmentByStratum” and “ResampleBioticAssignmentByAcousticPSU” are described. There are dangers to using the “ResampleBioticAssignmentByAcousticPSU” in that the variance may be lower than expected due to Hauls being resampled multiple times for the same Stratum, which smoothes out the extreme values.
Reverted the name change of Resample* functions back to using CamelCase and not underscore separated CamelCase (underscore between the word “Resample”, the data type, and the specification):
Added message when replaceDataList or replaceArgsList is used.
RstoxFramework v4.1.1-9001 (2024-11-15)
Changed unwanted error “Passed a filename that is NOT a string of characters!” when creating a process using ReportBootstrap and clicking on the drop down list for e.g. BaselineProcess, to a warning “Bootstrap output NetCDF4 file missing.” and with empty drop down as result.
Added removal of temporary files: 1. Shapefiles written by setRstoxPrecision() were not completely deleted (shx, dbf and prj were not deleted). 2. The NetCDF4 file written temporarily during bootstrapping and copied to the bootstrap process output was not deleted. 3. The temporary project description file used in validation in readProjectDescription() was not deleted.
RstoxFramework v4.1.0 (2024-11-04)
Final release for StoX 4.1.0.
Fixed bug in the function parameter hierarchy of ReportBootstrap, where empty ReportFunction caused an error.
RstoxFramework v4.0.1-9005 (2024-11-01)
Breaking change: Changed default from save = TRUE to save = FALSE in runModel(), runProject() and runProjects().
Fixed bug in runProject() where startProcess and endProcess outside of the range of processes resulted in a warning. In the new version these are truncated to the range of processes.
RstoxFramework v4.0.1-9004 (2024-10-18)
Changed how output files are deleted. Before, output files were deleted for all later processes in a model in addition to the processes of later models using any of these processes. Now, the processes which have an argument UseOutputData = TRUE are not deleted.
Refactored resampling functions used in Bootstrap() to save a resamplingFactor in the resampling and then scale the data using the new applyResamplingFactor().
Added support for running readProcessIndexTable() on a closed project.
RstoxFramework v4.0.1-9003 (2024-10-10)
Fixed bug in colors of processes to not show bold for ProcessData processes that are used by a later ProcessData process where this use is hidden by UseProcessData.
Added the resampling function Resample_PreySpeciesCategoryCatchData_Hierarchical, which does actual resampling by repeating entries that are sampled more than once, as opposed to scaling the data variable.
Renamed the resampling functions used in Bootstrap to the following convension: “Resample” + “_” + dataType + “_” + specification, where dataType is the StoX data type such as “MeanNASCData” and “BioticAssignment”, and specification is any string in CamelCase describing the resampling function, such as “ByStratum” and “ByAcousticPSU”:
Added the resampling function “Resample_PreySpeciesCategoryCatchData_Hierarchical” which should replace “Resample_PreySpeciesCategoryCatchData_HierarchicalUsingScaling” (the latter kept for testing in this pre-release).
Fixed bug where the function inputs to a process data process were not considered when UseProcessData is TRUE, with the consequence that the process was marked as terminal (bold in the GUI).
Added the progress of writing the nc file in Bootstrap() to the progress file (which is used by estimateTimeOfProcesses()).
Added explicit error message when a variable is requested that does not exist in a Bootstrap nc file.
Relaxed error to warning for unknown file extension in output files read through readModelData().
RstoxFramework v4.0.1-9002 (2024-09-18)
Changed to show TargetVariableUnit in ReportBootstrap() only when the ReportFunction is not a fraction (fractionOfOccurrence or fractionOfSum).
Changed the check-full.yaml to run both macOS arm64 and x86_64.
RstoxFramework v4.0.1-9001 (2024-09-01)
Fixed bug where a ReportBootstrap process could be run even if the Baseline model or the Bootstrap process was reset. Also introduced the columns usedInRecursiveProcessIndices, usedInRecursiveProcessIDs and usedInRecursiveProcessNames in getProcessTable() to support resetting processes using outputs from processes in previous tables.
Fixed bug where defaults were not given for Percentages and GroupingVariables in ReportBootstrap().
Removed stop in ReportBootstrap when Bootstrap() is not run, and rather showing the default warning.
Added resample function ResamplePreySpeciesCategoryCatchData().
Added vectorised support in getProcessNameFromProcessID() and getProcessIDFromProcessName()
RstoxFramework v4.0.0 (2024-07-09)
Final release for StoX 4.0.0.
RstoxFramework v3.6.3-9012 (2024-07-08)
Last pre-release before StoX 4.0.0 (jumping 3.6.3), including improvements to compareProjectToStoredOutputFiles() implemented while making all example projects on https://github.com/StoXProject/StoXExamples pass.
Added tablesCompared and tablesNotCompared to the output of compareProjectToStoredOutputFiles().
Changed unzipProject() to keep times of the files when unzipping.
Moved “addParameter” to be before “removeParameter” and “renameParameter” as backwaards compatibility actions, to facilitate adding a parameter with a value depending on existing values.
RstoxFramework v3.6.3-9011 (2024-07-02)
Added the arguments returnBootstrapData, selection, BootstrapID and unlistSingleTable in getModelData(), which can be used to return (a subset) of the actual bootstrap data, and not only the path to the bootstrap NetCDF4 file.
Fixed the problem of truncated time steps when writing bootstrap data to NetCDF4 file, due to R’s awkward bug with formatting POSIXct objects (the last decimal trucated).
Renamed backwardCompatibility to backwardCompatibility_RstoxFramework (and the same in the other Rstox-packages) in order ot avoid clashed with the backwardCompatibility object in other Rstox-packages.
Added warning when openProject() informing the used about the OutputVariables argument in Bootstrap().
Fixed bug where existing bootstrap data was deleted even when UseOutputData = TRUE.
Improved compareProjectToStoredOutputFiles() to work with comparing bootstrap data, and got rid of the argument mergeWhenDifferentNumberOfRows by applying merge automatically.
Fixed bug which made some plotting functions failing seemingly randomly, by no longer setting precision in plot functions.
Temporarily disabled the tests test-export_ICESAcoustic.R and test-export_ICESbiotic.R due to problems at ICES.
RstoxFramework v3.6.3-9010 (2024-05-28)
Renamed “Function” to “Function name” in the GUI.
Added “Survey” and “SpeciesCategory” as GroupingVariables in ReportBootstrap().
RstoxFramework v3.6.3-9009 (2024-05-22)
Added truncation of output from ICESDatsusc() and similar functions in the Preview in the GUI.
Added message about how to read a bootstrap NetCDF4 file into R to replicate the old bootstrap RData file.
Fixed bug where empty tables showed with duplicated header row in Preview in the GUI.
Added the option ‘unlist’ to getBootstrapData().
Added support for AggregationFunction in ReportBootstrap() for backward compatibility of R scripts.
Added support for nc files in readStoxOutputFile().
Updated the following test projects for the breaking change in RstoxBase where rows with 0 Abundance are deleted from the QuantityData before merging with the IndividualsData in SuperIndividuals(), which removes unwanted rows with present SpeciesCategory and IndividualTotalLength but missing Abundance when Biotic PSUs with rare IndividualTotalLength are not re-sampled in a bootstrap run.
RstoxFramework v3.6.3-9008 (2024-05-02)
Fixed bug in getFilterTableNames() where the json array was unboxed in runFunction.JSON() (due to auto_unbox = TRUE) when only one name was returned. Fixed by enclosing in a list if length is 1.
Fixed the function unReDoProject(). This is now ready to be implemeted in the GUI.
Fixed bug where empty process output due to modification of process data caused error on right click on the process (changing from return(NULL) to return(list()) in getProcessOutputElements()).
Fixed bug where modifying process data in DefineAcousticPSU() or DefineBioticPSU() could not be saved past the first click on the save icon.
Fixed bug in Bootstrap() where character columns with all missing values were written as “N” and not “NA”.
Fixed bug in Bootstrap() where SpeciesCategory containing nordic characters were truncated.
Fixed bug in getBootstrapData() where DateTime was not converted to POSIX.
RstoxFramework v3.6.3-9007 (2024-04-23)
Relaxed validation of the project.json to only consider the first 6 rows (using utils::head()) of each table or sf object. This was due to an observed crash of jsonvalidate::json_validator() for project.json of size larger than 1/2 GB.
Renamed AggregationFunction to ReportFunction.
Renamed AggregationWeightingVariable to WeightingVariable.
Fixed bug where help for a topic aliased by another topic did not work in getObjectHelpAsHtml() used by the GUI (e.g. var which is documented in cor).
Moved all warnings about only one value in stratum to onlyOneToResample_Warning() used in boot strapping.
Fixed bug where the bootstrap attributes processNames and dataTypes were not written past the first value.
RstoxFramework v3.6.3-9006 (2023-12-19)
Fixed bug where TargetVariable and GroupingVariables did not get possible values.
RstoxFramework v3.6.3-9005 (2023-12-18)
Fixed bug in Preview of ReportSpeciesCategoryCatchData, where the column V1 was overwritten when adding line indices.
RstoxFramework v3.6.3-9004 (2023-12-01)
Changed the functions Bootstrap() and ReportBootstrap() to use the netCDF4 files.
Added the function bootstrapRDataToNetCDF4() for converting old bootstrap RData to the new nc files.
Added the function getBootstrapData() for reading tthe new bootstrap nc files into R (supplementing the function load() used to read in the old bootstrap RData files)
Added the function getProject() for use by the GUI to get saved status of a project.
Changed to delete all output folders from the process to be run and onwards.
Changed to reset to the previous process if changing the current.
Fixed bugg where character vector outputs were displayed with one letter per line in the GUI.
Renamed the argument ignore to ignore.variable and added the argument ignore.process in compareProjectToStoredOutputFiles().
Implemented the “single” format class of parameters like PlottingVariable and CVVariable.
Changed inst/test/coastalCod_20.zip and inst/test/tobis_20_depth.zip to comply with the new platform inndependent sortinng when generating StratumLayerIndividualIndex (previous IndividualIndex which had only numbers as the first characters in the test projects).
RstoxFramework v3.6.3-9002 (2023-11-08)
Added working openProjectAsTemplate().
Added arguments empty.processData and processDataToBeEmptied to copyProject().
Added argument return.processFlow to getProcessTable() to support visualizing the input and output processes to a process.
Moved formatProcessData and dependent functions such as toJSON_Rstox() and convertStringToNA() to RstoxBase, as these are needed to read project.json for DefineStratumPolygon, DefineAcousticPSU, etc.
Restructured Interactive.R so that functions like addAcousticPSU() and the new addBioticPSU() use commmon PSU functions.
Fixed bug in modifyStratum(), which had some stray sp code.
Added getFilterTableNames() and getFilterOptionsOneTable() to support speed up of the filter expression builder in the GUI.
Sped up sortUnique() for strings. using the R package strigi.
Moved definitions of StoxDateTimeFormat, emptyStratumPolygon and emptyStratumPolygonGeojson to RstoxData and RstoxBase.
Added the arguments check.columnNames_identical and testAllTRUE to compareProjectToStoredOutputFiles().
Temporarily added ListFilesInFolder() to test selecting a folder in the GUI.
Renamed ResampleBioticAssignmentByPSU to ResampleBioticAssignmentByAcousticPSU
Changed to returning a list and to create the full projectSession folder structure in openProjectAsTemplate().
Added check for change of Rstox packages for an open project.
Allowed selecting from possible values in the filter expression builder for numeric values which are mostly whole numbers. Also excluded possible values for keys.
RstoxFramework v3.6.3-9001 (2023-08-31)
Removed dependency on the retiring package sp.
Speeding up openProject() for StoX projects with large process data tables.
Moved functions to set precision to RstoxFramework, and fixed the following two bugs: 1. Datatypes which are lists of lists (AcousticData and BioticData) were not set precision to. 2. Integer fields were set precision to.
Fixing a problem with setting default precision in StoX. Before, precision was not set for process outputs which were lists of lists of tables (ReadBioic() and ReadAcousic()). Also, all numeric columns, even integer ones were set precision to, which is now changed to exclude integer columns.
Changed isOpenProject() to only require that the projectSession folder exits, with an option strict = TRUE to use the old requirement that all folders must exist.
Added BootstrapNetCDF4() and ReportBootstrapNetCDF4(). These will replace Bootstrap() and ReportBootstrap() in StoX 4.0.0.
Added ResampleBioticAssignmentByPSU() and ResampleBioticAssignmentByStratum(), where the latter is identical to the ResampleBioticAssignment() of StoX <= 3.6.2.
Fixed bug where runProject() did not open the project.
Added printing of messages, warnings and errors for parallel bootstrapping (by applying runFunction() in each core).
Added the number of identical warnings in the warning printout. This is needed e.g. to get an idea of how many bootstrap replicates that has a problem of missing assignment length distribution for AcousticPSUs.
Changed how runFunction() saves messages, warnings and errors.
Added the option empty.memory to copyProject().
Added the option msg.GUI to runProcess() and runProcesses() to support not printing the “Running baseline process” type of messages in backend but rather in frontend, so that this gets printed before the process runs and not after.
Added warning when replaceArgs contains non-existent arguments.
Changed to using unlistDepth2 = FALSE in compareProjectToStoredOutputFiles(), as this is in line with the bug fix from StoX 3.6.0 where outputs with multiple tables were no longer unlisted in Bootstrap data.
Increased tolerance in test-tobis_20_depth.R.
RstoxFramework v3.6.2 (2023-06-28)
Added example of using replaceArgsList in runModel().
Exporting the new process getProcess() and renaming the internal function getProcess() to getProcessArguments().
Fixed bug in replaceArgsList, where replacements identical to replacements for other processes were removed.
Modified check-full.yaml to deal with ordinary releases on the StoXProject/repo and pre-releases on the StoXProject/testingRepo
RstoxFramework v3.6.2-9001 (2023-06-26)
The functions runModel(), runProject() and runProject() have gained a parameter ‘force.save’ which saves a project even if there are no changes, as opposed to save = TRUE.
Updated the test projects coastalCod_20 and cod_19 to have RData as Bootstrap output, since StoX 3.6.1 introduced the error that this file was txt.
Added check for output file names in the tesing.
Added functions to modify projects (modifyProject()). These are preliminary and not tested.
Added definitions and functions to prepare for bootstrapping using NetCDF4 files.
Support for duplicating a process in the GUI.
RstoxFramework v3.6.1 (2023-04-28)
Fixed bug when on R 4.3 where StoX could not be opened on MacOS and R connection failed on Windows.
Stopped using the Versions.R file in the StoX GUI, but rather separated out the functions used by the GUI to an exclusive GUI file. Simplified functions for getting versions used in the project.json file.
Improved how StoX changes the active process so that setting a parameter without actually changing it value does not reset the process.
Fixed bug in StoX 3.6.0 where simply selecting a process in a model would reset the later models.
Added support for specifying startProcess and endProcess in runProject() and runProjects() as a list named by the proecsses, such as endProcess = list(report = 2) to only run the first two processes of the report model.
Fixed bug in runProjects(), where processes returning StratumPolygon and BioticData and AcousticData could not be included in the processes argument.
Added support for arbitraty name of first argument in functions used in replaceData.
Fixed bug in modifyProcessNameInFunctionInputs() where function input were modified only in the same model, and failed when at least one function input was empty.
Changed to check function input errors only for enabled processes.
Improved warming for function input not enabled (added the name of the process).
Preparations for writing bootstrap data to NetCDF4.
Fixed bug where slash and backslash were mixed in file name in json schema validation error message. Now using only slash. Also changed this to a warning instead of an error, so that StoX tries to open the project anyhow.
Added LogDistance to tooltip for EDSUs in the map.
Changed the requirements of the the BaselineSeedTable of the function Bootstrap to only need the ImputeSuperIndividuals processes which use ImputationMethod = “RandomSampling”.
Added the option prependProcessList in runProcesses(), runModel(), runProject() and runProjects().
Added the option of giving a string vector holding the names of the models to return data from in returnModelData in runModel(), runProject() and runProjects().
Improved error message when there are missing LogOrigin or LogOrigin2.
Added functions to compare old and new StoX output: compareSweptAreaBaseline().
Changed the error “The BaselineSeedTable must contain Seed for the processes…” to ignore ImputeSuperIndividuals proecsses with Regressio method (no seed required).
Reduced memory for large BootstrapData in ReportBootstrap() by sending only the relevant columns to the report function.
RstoxFramework v3.6.0 (2023-01-14)
Summary
In this release RstoxFDA package is included as an official but optional package. The new version includes a number of changes supporting improvements in the StoX GUI, as well as important bug fixes.
General changes
Added the parameter Percentages with default c(5, 50, 95) in ReportBootstrap() when BootstrapReportFunction = “summaryStox” (currently the only option).
Reversed the order of installation of Rstox packages for pre-releases, to ensure that the lower packages get the correct ersion (ultimately RstoxData).
Added RstoxFDA to OfficialRstoxFrameworkVersions.txt.
Added Date to OfficialRstoxFrameworkVersions.txt and removed all versions prior to StoX 3.0.0.
Updated Versions.R to supprort RstoxFDA in the list of package versions in the StoX and RstoxFramework logo inn the GUI upper right corner.
Removed the test project tobis_20, as it is covered largely by the test project tobis_20_depth.
Updated the test projects catch_99, coastalCod_20, cod_19, haddock_19, splitNASC_18 and tobis_20_depth, and added 1e-12 tolerance in the tests.
Removed rows of the output from ReportBootstrap() that contained combinations of the GroupingVariables that are not present in the BootstrapData. There rows were created to ensure that all bootstrap runs contain all combinations of the GroupingVariables, but also introduced non-existing combinations.
Improved documentation of seed in Bootstrap().
Added support for pre-releases, which are not deployed to the StoX repo.
Updated tests to document the StratumArea change when switching to sf.
Detailed changes
Added the parameter empty.input to CopyProject().
Added unfinished PlotReportBootstrap().
Prepared for adding tolerance to tests.
Bug fixes
Fixed bug in output file of Bootstrap() when OutputProcesses contained processes with more than one table (e.g. the Data and Resolution table of Quantity()) mixed with single table outputs (e.g. ImputeSuperIndividuals()). The list of output data was flattened to include e.g. Quantity_Data and Quantity_Resolution. However, for BootstrapData, the output is saved to an RData file, and no such flattening of the list is necessary, and also corrupts the data when read back in when using the UseOutputData option in Bootstrap(). This may break scripts using the output file of a Bootstrap process with datta from multi table processes. This is however rare, and the function RstoxFramework::unlistToDataType() can be used to re-create the previous list in the output file of Bootstrap processes.
Fixed bug in the GUI, where running a process in one model did not reset all later models.
Fixed bug in PlotBootstrap().
Fixed bug with slashes in sub plot names in PlotReportBootstrap().
Fixed bug when running a project with projectPath ending with exactly one slash (“/”) (problem fixed in getRelativePath()).
Fixed bug in pkgdown.yaml.
RstoxFramework v3.6.0-9003 (2023-01-10)
Fixed bug in output file of Bootstrap() when OutputProcesses contained processes with more than one table (e.g. the Data and Resolution table of Quantity()) mixed with single table outputs (e.g. ImputeSuperIndividuals()). The list of output data was flattened to include e.g. Quantity_Data and Quantity_Resolution. However, for BootstrapData, the output is saved to an RData file, and no such flattening of the list is necessary, and also corrupts the data when read back in when using the UseOutputData option in Bootstrap(). This may break scripts using the output file of a Bootstrap process with datta from multi table processes. This is however rare, and the function RstoxFramework::unlistToDataType() can be used to re-create the previous list in the output file of Bootstrap processes.
Fixed bug in the GUI, where running a process in one model did not reset all later models.
Added the parameter Percentages with default c(5, 50, 95) in ReportBootstrap() when BootstrapReportFunction = “summaryStox” (currently the only option).
Reversed the order of installation of Rstox packages for pre-releases, to ensure that the lower packages get the correct ersion (ultimately RstoxData).
RstoxFramework v3.6.0-9002 (2022-12-24)
Added RstoxFDA to OfficialRstoxFrameworkVersions.txt.
Added Date to OfficialRstoxFrameworkVersions.txt and removed all versions prior to StoX 3.0.0.
Updated Versions.R to supprort RstoxFDA in the list of package versions in the StoX and RstoxFramework logo inn the GUI upper right corner.
Fixed bug in PlotBootstrap().
Fixed bug with slashes in sub plot names in PlotReportBootstrap().
RstoxFramework v3.6.0-9001 (2022-12-13)
Removed the test project tobis_20, as it is covered largely by the test project tobis_20_depth.
Updated the test projects catch_99, coastalCod_20, cod_19, haddock_19, splitNASC_18 and tobis_20_depth, and added 1e-12 tolerance in the tests.
Added the parameter empty.input to CopyProject().
Fixed bug when running a project with projectPath ending with exactly one slash (“/”) (problem fixed in getRelativePath()).
Removed rows of the output from ReportBootstrap() that contained combinations of the GroupingVariables that are not present in the BootstrapData. There rows were created to ensure that all bootstrap runs contain all combinations of the GroupingVariables, but also introduced non-existing combinations.
Added unfinished PlotReportBootstrap().
Prepared for adding tolerance to tests.
Improved documentation of seed in Bootstrap().
Fixed bug in pkgdown.yaml.
Added support for pre-releases, which are not deployed to the StoX repo.
Updated tests to document the StratumArea change when switching to sf.
RstoxFramework v3.5.2 (2022-11-21)
Added the parameter TargetVariableUnit in ReportBootstrap().
Added the memory file “dataType.txt” to save the data types for bootstrap output (the Bootstrap functions sets the data types as attributes to the individual baseline process outputs, and then this is picked up by writeProcessOutputElements()).
Removed warning when a PSU to be added assignment to is not present in the BioticAssignment (this should be no problem, as PSUs are added with).
RstoxFramework v3.5.1 (2022-11-14)
Fixed bug when the GUI expects png.
Completed some docs.
RstoxFramework v3.5.1-9001 (2022-11-10)
Removed warning when a preview is open in the GUI and the process is changed (setting warn to FALSE in getProcessTableOutput(), getProcessGeoJsonOutput() and getProcessPlotOutput()).
Added the parameter deleteCurrent in resetModel() to facilitate deleting the output of the current process, used by all functions that modify processData interactively, and by setProcessPropertyValue().
Fixed bug where EDSUs for StoX projects with data from ICESAcoustic data with and without end position given by Longitude2 resulted in EDSUs not being shown.
Added support for saving output files frorm plotting functions.
Added renameStratum() for use by the GUI.
Added removeAllAcousticPSUsOfStratum().
Disalowed empty string stratum name from the GUI.
Added getProcessOutputElements(), getProcessTableOutput(), getProcessGeoJsonOutput() and getProcessOutput() for use in Preview in the GUI.
Added the file outputClass.txt to identify the class of the outputs of each process, used in getProcessOutputElements().
Added a line “… truncated” if a table in Preview does not contain all rows (the GUI shows at most 200000 rows).
Cleaned up JSON validation test files to enhance the expected error.
Improved error message when readProjectDescriptionJSON() fails to read project.json.
Disabled warning in getProcessTableOutput(), getProcessGeoJsonOutput() and getProcessPlotOutput() occuring when changing a parameter of the process.
Changed to ignoreAttributes = FALSE in getProcessPlotOutput().
RstoxFramework v3.5.0 (2022-08-12)
Start of using semantic versioning (https://semver.org/). Before this release the two first version numbers represented the major and minor release number, in accordance with semantic versioning, whereas the third version number identified test versions. The major and minor releases (versions ending with 0.0 or 0) were considered as official versions. From this release and onwards, the third version number will represent patches (bug fixes), and are to be considered equally official as the major and minor releases. In fact, as patches are restricted to fixing bugs and not adding new functionality, the latest patch will be the recommended version.
RstoxFramework v3.4.6 (2022-08-10)
Added truncation to 1000 characters for messages, warnings and errors
RstoxFramework v3.4.4 (2022-08-07)
Added optional validation of the project.jsos in readProjectDescription().
Added options to compareProjectToStoredOutputFiles() (setNATo0 replaecd by NAReplacement, ignoreEqual to ignore columns where all values are equal, mergeWhenDifferentNumberOfRows to use all_equal_mergeIfDifferentNumberOfRows instead of all.equal, and sort to sort the tables).
Added the diffData as output from compareProjectToStoredOutputFiles() to assist identifying the diffs.
RstoxFramework v3.4.3 (2022-06-22)
Changed to using null to denote missing values (NAs) in the project.json, instead of “string” in jsonlite::toJSON().
Added formatting of parameter tables read from the GUI.
Changed to using only the first primitive type of a table column defined in a process data JSON schema, when formatting process data.
Modified the test project splitNASC_18.zip according to the correction of the error in “DateTime” in StoxAcoustic (seconds dropped for ICESAcoustic data).
Fixed bug in Versions.R, which is used by StoX for the tool “Install Rstox packages”. The bug was that the package data.table was used but not installed. Also, added support for installing Rstox package binaries built with older R versions than the one installed, allowing for installation of Rstox packages in existing StoX versions even when a new R version is released and installed. In R 4.2. the location of the folder in which user installed packages are saved has changed from the Documents folder to the AppData > Local folder of the user, which is now included in Versions.R.
Added the parameters onlyStoxWarnings and onlyStoxErrors to runFunction().
Added the parameter empty.output in copyProject().
Updated test projects coastalCod_20, export_ICESbiotic, splitNASC_18, tobis_20 and tobis_20_depth according to the change in RstoxBase where AssignmentLengthDistribution now outputs WeightedNumber normalized to 100 per PSU.
RstoxFramework v3.3.7 (2022-03-22)
Added expandProcess() and extractErrorIDs()
RstoxFramework v3.3.6 (2022-03-15)
Fixed bug in removeEDSU(), where EDSUs to remove were assigned empty string instead of NA as PSU.
Added export HOMEBREW_NO_INSTALLED_DEPENDENTS_CHECK=false in check-full.yaml to prevent Homebrew from re-installing R with .Platform$pkgType = “source” on Mac.
RstoxFramework v3.3.5 (2022-03-03)
Modified tests export_ICESbiotic.zip and export_ICESAcoustic.zip for the new ICES formats.
RstoxFramework v3.3.4 (2022-02-28)
Reduced time of ReportBootstrap() to a few percent.
Changed all sd and cv in reports from 0 to NA. Standard deviation = 0 is no longer accepted by StoX, as it implies either insufficient number of bootstraps or only one value to sample from in the bootstrapping.
Fixed bug where the blue dot marking processes as ‘run’ was turned on on a newly modified process when immediately modifying a later process.
Moved setting precision to runProcess() instead of each StoX function.
Fixed bug when working with a DefineStratumPolygon process with no polygons defined (readProcessOutputFile() did nor read deal properly with the empty SpatialPolygonsDataFrame with jsonlite::prettify(geojsonsf::sf_geojson(sf::st_as_sf(data))), but ok when using replaceSpatialFileReference(buildSpatialFileReferenceString(data)) instead).
Changed to using StratumName instead of the old polygonName in stratum polygons throughout RstoxFramework and the StoX GUI.
Changed to using RstoxData::firstClass instead of a copy.
Added order of backward compatibility actions to package first (alphabetically), then change version (numerically), and finally action type with order as given by RstoxFramework::getRstoxFrameworkDefinitions(“backwardCompatibilityActionNames”).
RstoxFramework v3.3.3 (2022-02-14)
Added InformationVariables to ReportBootstrap().
RstoxFramework v3.3.2 (2022-02-10)
Added reshapeParameter and reshapeProcessData as backward compatibility actions.
Cleaned up backward compatibility actions and added StoX-messages when verbose = TRUE.
Removed applyBackwardCompatibility() at saveProject() as the GUI closes the project when updating Rstox packages.
Updated test projects BIAS_19_ICES, catch_99, export_ICESAcoustic, export_ICESbiotic according to the change in RstoxData::DefineTranslation() in (RstoxData v1.5.7), and the change in the output of ICESAcoustic(), ICESBiotic(), where multiple input files are rbinded resulting in non-file-specific output table name.
RstoxFramework v3.2.3 (2022-01-12)
Updated ResampleMeanLengthDistributionData() and ResampleMeanSpeciesCategoryCatchData() to use number instead of count.
Added close of projects in runModel() and runProject() and delting project copies in Bootstrap() on.exit.
RstoxFramework v3.2.2 (2022-01-10)
Added ResampleMeanSpeciesCategoryCatchData(). Added test for functioning help-pages. Updated tests.
RstoxFramework v3.2.1 (2022-01-07)
Added renameColumInProcessDataTable as backward compatibility action. Changed to using AJV. Dropped the option of saving and reading project.RData. Added a second json validation after backward compatibility action, in case the first did not pass.
RstoxFramework v3.1.21 (2021-12-22)
Added coastal cod test project with empty PSUs, stratum names ordered as “Loppa” before “indre”, and NA in Beam for certain acoustic PSUs.
RstoxFramework v3.1.19 (2021-12-13)
Added escaping newline and tab when writing output tables to txt, in order to read back in. Fixed bug in readStoxOutputFile() when no character columns are present.
RstoxFramework v3.1.18 (2021-12-03)
Added option of reading empty strings as NA in readModelData() to support output files from StoX <= 3.1.0.
Added support for hybrid StoX 2.7 and >= 3 projects, using the same project folder.
Fixed bug where only BioticAssignmentWeighting was available for selection in BootstrapMethodTable in Bootstrap() in the GUI, whereas only DefineBioticAssignment is correct. U
Updated test projects to match changes in RstoxBase.
RstoxFramework v3.1.17 (2021-11-22)
Added the requirement jsonvalidate >= 1.3.2, as per changes in JSON definition.
Modified test projects BIAS_19_ICES, cod_19, export_ICESbiotic, haddock_19, tobis_20 and tobis_20_depth for StoX 3.2.0 (ensuring reproducibility to StoX 3.1.0)
Added test for SplitNASC versus StoX 2.7s.
RstoxFramework v3.1.16 (2021-11-08)
Added tests comparing results to StoX 2.7 for Barents sea cod 2020 and sandeel 2011.
RstoxFramework v3.1.14 (2021-11-04)
Updated validation of project.json (using processDataSchema).
RstoxFramework v3.1.13 (2021-10-24)
Fixed bug in getProcessOutputFiles() where project paths containing special characters resulted in corrupt file paths, causing View output to crash.
Added DefineBioticPSU() to convertStoX2.7To3().
In readProjectDescription(), StratumNameLabel is now set to “StratumName”, in case the stratum polygon was added from shapefile or GeoJSON in StoX < 3.2.0.
RstoxFramework v3.1.11 (2021-10-15)
Added support for mixed level function outputs, whereas only a list of tables or a list of lists of tables were previously allowed. This fixed bug when a two table output process was included as output from Bootstrap.
Added support for two table output processes in Bootstrap, where only the table “Data” is used.
RstoxFramework v3.1.10 (2021-10-05)
Fixed bugs in getObjectHelpAsHtml() which caused all links to fail.
RstoxFramework v3.1.9 (2021-09-28)
Changed output text files (located in the output folder) from un-quoted files for all values (numeric, character, time, logical) to files where all character class values are quoted with “. Also missing values are represented by empty space in the preivous version and NA (un-quoted) in the new version. This ensures equality in class when reading the files back in using RstoxFramework::readModelData().
Modified Versions.R to support installing from source when on Linux. Also, fixed bug where Rstox packages were not sorted hierarchically when installing with installOfficialRstoxPackagesWithDependencies().
Fixed bug where emptying a field in the filter expression builder caused syntax error.
Fixed bug where acoustic PSUs could be added even if the process using DefineAcousticPSU was not active.
Changed warning to error when processes listed in OutputProcesses in Bootstrap().
Added warning when UseOutputData or RemoveMissingValues is TRUE.
Added runProject_ReplaceAcousticFiles().
Added parameter update.functionInputs in modifyProcessName().
Added function findProcess().
First working version of convertStoX2.7To3(). Emptying unused arguments in processes modified by convertStoX2.7To3().
Added check for equality of numeric values in the reports in compareProjectToStoredOutputFiles().
RstoxFramework v3.1.2 (2021-08-19)
Updated test projects for ICES export to pass the initial checks on https://acoustic.ices.dk/submit. Moved toJSON_Rstox() from RstoxBase to RstoxFramework, and moved reading AcousticPSU, BioticAssignment and StratumPolygon the other way.
RstoxFramework v3.0.30 (2021-06-16)
Added parallel bootstrapping.
Added BaselineSeedTable in Bootstrap().
Added testing of full projects (using parallel testthat). Completed documentation. Added readModelData().
Changed name of output text files to not contain the process name.
Added runProjects().
Added warning if Rstox packcages to be installed are not built on the installed R version.
Fixed bug where NAs were not preserved in project.json. Fixed bug in createProject().
Added support for mixed OutputDepth (particularly useful in Bootstrap).
Reintroduced possible values in filter for all-unique variables such as Station and EDSU. Allowing drop down list of only one * unique element.
Added encoding = UTF-8 in readStoxOutputFile().
project.json now uses ISO8601 for time..
RstoxFramework v3.0.0 (2021-02-11)
Final version for the release of StoX 3.0.0.
RstoxFramework v1.2.40 (2021-01-30)
Added %notequal%.
RstoxFramework v1.2.39 (2021-01-28)
Fixed bug with possible values of length 1 being dropped.
Renamed official to certified in the project.json.
Removing empty function arguments in runProcess(), in order to use the error “argument ___ is missing, with no default”.
Added warning for non-official project.json
RstoxFramework v1.2.38 (2021-01-21)
Fixed bug where Hauls could not be removed from assignment.
Added support for numeric, integer and logical vectors in addition to the already supported character vector in data types.
RstoxFramework v1.2.33 (2021-01-12)
Renamed GUI to Application in project.json.
RstoxFramework v1.2.33 (2020-12-22)
Added backwards compatibility (for new projects).
Increased timeout when downloading packages.
Replaced geojsonio by geojsonsf to reduce dependencies.