7.4¶
Note
As of version 7.4, the .Net Core platform is upgraded from net6 to net8. The default docker port is now 8080. For users on SQL Server, the minimum supported version is now SQL Server 2016.
7.4.10430¶
October 31st, 2024
Colectica Repository and Portal¶
Added¶
Portal show a banner when there is a newer version of an item
Portal explore view auto configuration: when only one PhysicalInstance exists and it has VariableGroups that are TimePeriods, use those to define the columns.
Portal explore auto configuration. When the ConceptScheme is not in a Group, enable Variable and Question lists but not concordance tables.
Portal concordance: allow 0..n ColumnDefiningItemIds. During auto-config, use any Groups that contain the ConceptScheme, and detect whether to use PhysicalInstances or VariableSchemes based on whether PhysicalInstances exist.
Portal Data Collection view: show both Oragnizations and Individuals in the Data Collection Organizations table
Portal: Option to not show dataset download links on PhysicalInstance page
Portal Add Excel download of Statistical Classification
Portal Add Level to csv and Excel downloads of Statistical Classifications
Portal Improve performance of Datatable to Excel converter
Portal PhysicalInstance explorer: show VariableGroup description when present
Portal show Type help tooltip for Wide concordance tables
Portal: Enable Compare link in revision history
Explore view concordance improvements for multi-series, one-to-many, and compact view
Repository CLI add DDI export via DB connection
Repository CLI handle upgrading DDI 3.1 and 3.2 to DDI 3.3
Repository CLI ddi 3.3 upgrade: create new items from embedded DDI types in 3.1 also
Repository cli command to upgrade metadata items to DDI 3.3
Portal: display information from ResponseText ~ResponseDomains
Changed¶
Portal: in variable concordance view, link the dataset title to its detail page
Portal search page: when using Elasticsearch, show link to last page, along with the number of the last page.
Portal concordance tables: show item type images in column headers; if a public FileIdentification is available, show a link to it in the data file column header cell
Portal: Load explore view configuration from repository settings, when present
Portal Variable page updates: don’t show empty “Source Questions” section; don’t show concordance; move links to RepVars and ConVars to the main description area; don’t use Instrument node styles for Lineage tree
Portal search page: For the Item Type -More… link, show all item types. Previously, it only showed ones not included in the main Item Type dropdown.
Update for CVE System.Text.Json, System.IO.Packaging, System.Runtime.Caching
Update to net8.0.10
Statistical Classification CSV export: Use “-” instead of “@” as language separator
Delete processing: lookup children faster
Portal Don’t show DDI download links for DDI versions that do not support the item
Portal return 404 if DDI for an item is requested in a specific DDI version that does not support the item type
Designer improve version check task handling
Elastic indexer addins: optionally specify an ID for a codelist that holds the enumerated values
Portal: Update search syntax for fuzzy search to be consistent
Fixed¶
Repository fixed ensure latest item is correctly marked when multiple versions are submitted in parallel
Repository use MIN instead of MAX when computing grouped texts for search, as results are descending order
Updated debian apt sources file location in Dockerfile for font installation
Repository fix new next offset based paging when using text search
Portal: fix to maintain user metadata language when navigating to the Search page. Remove redundant languages-data blob from the search page.
Portal concordance tables: don’t show extra scrollbar for the page;
Portal concordance tables: when scrolling vertically, only the lowest level column header should stick to the top
Portal handle year month dates with an invalid month
Designer handle invalid custom controlledVocabularies.json files during startup
Fix Microsoft transitive dependency issue in openid connect handler
Colectica Designer¶
Added¶
Designer question view: show UI for NominalDomain
Designer: For DataCollection-Collection Event-DataCollectorOrganizations, allow referencing either Organizations or Individuals
Designer: allow configuring UserID types that should should show by default, per item type
Designer: allow editing DdiInstance, Group, and StudyUnit directly on the repository. Save in a transaction.
Designer: also allow editing ResourcePackage directly on the repository
Designer: allow referencing an item that succeeds a deprecated item
Size in bytes for Designer, Portal, and Reporting
Designer automatically determine Size in bytes of Other Material via url
Designer: app config for new item-picker-last-location settings
Designer: command to create StatisticalClassification from a CodeList
Designer: show editor for ResponseText ~ResponseDomain type
Changed¶
Designer Create Dataset from Instrument command: create the dataset as a checkout instead of referencing it in a parent ResourcePackage; For Code questions with select-multiple option, include category label in the variable labels.
Designer weighted statistics calculations: do not apply weights to categorical values for min and max. Do apply weights for all frequencies, including valid, invalid, and total counts.
Designer Import DDI command: only allow selecting one file in the Open File dialog
Fixed¶
Designer: remove some legacy commands
Designer Update from File: fix for detecting diverging code lists
Designer Compare With dialog: fix Save HTML button
Designer ResourcePackage editor: populate ResourcePackage creator and contributors, so organization references show correctly
Designer summary statistics: populate managed missing values items, so codes within those lists count as missing
Designer Update from File command: properly modify code lists for variables that formerly shared a code list, but when the code list differs in the new dataset
Colectica Questionnaires¶
Added¶
Questionnaires PDF spec: include native code from computations
Questionnaires Outputs CSV: include the DDI URN
Changed¶
Questionnaires Blaise 5 generation: for Data Lookups, use first item as the primary key even if it was not created first
Blaise Questionnaires prefer native blaise code if both blaise and neutral exist in a computation
Fixed¶
respect the Is Assigned to Field checkbox to determine FIELD vs AUXFIELD placement.
Questionnaires update replacement text and computation input/outputs correctly when under display logic
Questionnaires Show correct input parameter counts when using display logic
Questionnaires Show correct hover text for input parameter button when using display logic
Questionnaires Refresh input parameter button correctly when using display logic
Questionnaires continue validation checks beneath if conditions around sequences
Questionnaires validation check for multiple response domains and no attachment location
Questionnaires validation check for attachment location that isn’t present
Colectica Workflow¶
Fixed¶
Verify URL scheme for attached Other Materials during workflow file replications
Increment minor version to 7.4
Fix Microsoft transitive dependency issue in OpenID Connect handler
Colectica SDK¶
Added¶
SDK include Directory.Packages.props in SDK install so Addin developers can use the same package versions as Designer easily
SDK support Individuals in Data Collector Organizations list
SDK allow addins to be loaded from Common App Data (%ProgramData%)
Documentation generation: support numbered lists, underlines, and tables with thead/tbody
SDK more efficient IsEmpty for multilingual strings and audiences
SDK allow identifier service to use a string context when assigning a new uuid
SDK harmonize identifiers can now take an optional custom IIdentifierService
SDK add SizeInBytes to OtherMaterial in DDI 3.3
SDK Add GeographicLocationReference to SpatialCoverages
SDK Expose loaded XDocument in the DdiReader
SDK Child handling methods for Coverage
SDK Add FullName to Individual
SDK Add GeographicLocationScheme, GeographicLocation, and LocationValue
SDK method to determine in an item type can be represented in a specified format
Changed¶
SDK change SucceededBy from identifiertriple to typedidtriple
MultilingualString: copy audience strings during Copy(). Expose AudienceStrings as a property.
SDK create a minimum two GridResponseDomains when an attachment location is present in 3.3 serializer
SDK write subgroup not group in DDI 3.2 instance formats
SDK create out parameters for textdomain, codedomain, and numericdomain if present
Fixed¶
SDK don’t allow invalid months to be set on a year month type Date
7.4.10293¶
August 9th, 2024
Colectica Repository and Portal¶
Added¶
Portal: show FundingPeriod property
Portal: date facet options on search page
Portal: On single item type search pages, only show custom facets when they support the item type. For the all-items search page, show a message indicating the facet may only be applicable to certain types.
Portal: site map at /sitemap_index.xml
Portal allow report generation in user specified languages
Repository (performance) use bulk streaming item registration for registeritems and transaction commits
Repository migrate SQL Server compatibility level to the level of the current database
Repository advanced search: index grantNumber as a locator
Repository advanced search: index TypeOfStudy/Group
Elasticsearch add date range custom field
Elasticsearch indexer use global scoped mutex so single instance is also assured when running on linux
Repository CLI: option to delete set of items, or only a single item
Repository add health checks for minimum free disk space on log and cache drive
Repository settings for minimum free disk space
Changed¶
Portal: within CollectionEvents, show links to other items in lists instead of headered tables, since the CollectionEvent already has a header
Portal variable page: Show a table of question details, including question text, instead of just linking the question name.
Portal display Frequency even when it is set to a weighted frequency
Portal StudyUnit and DataCollection pages: show links to QualityStatements
Repository store current feature list in the settings table on startup
changed platform to net8
Repository simple validation of declared language tag formats
Elastic when building an index with no languages saved yet, include en in addition to en-US to match defaults viewed in the Portal
add RevisionNumber.txt to linux packages
Portal Interviewer Instructions page: show OtherMaterials
Repository security upgrade for PostgreSQL client library GHSA-x9vc-6hfv-hg8c
Portal trust html files installed in a theme directory
Portal don’t process .html page block files for markdown
Portal: don’t process home page custom content through Markdown renderer, to match old behavior
Repository add logoff user menu item when using OpenID Connect
Repository don’t default Microsoft logging in serilog to Informational
Repository error message for advanced search enabled on sql server where it is not supported
Repository reuse existing repository transactions in streaming commit
Repository send back a nice problem details to Designer when a commit fails for an unknown reason
Portal dataset explorer view: load variable details and statistics on-demand, to use less memory
Portal: show the correct language for CodeValue properties that have a controlled vocabulary assigned
Portal elasticsearch handle date range searches without end dates indexed
Portal basket details page: localized date display
Portal admin added a button to request full reindex on Elasticsearch
Portal admin only show Elasticsearch status boxes if it is enabled
Fixed¶
Portal: When showing a code list as a classification, correctly find child items
Portal new user email confirmation: do not require log in before marking as confirmed
Portal: Fix Log Off link when a home page redirect is configured
Repository: upgrade dependencies to address CVEs in Microsoft dependencies
Repository use async instead of sync Disposing of XML writer on OAI get streaming records
Repository ensure OAI getrecord is asynchronously flushed before returning.
Repository install fonts package in docker build
Repository require LocalJwtProvider:SymmetricSecurityKey to be at least 32 characters (up from 16) due to updated Microsoft default security requirements
Repository work around PostgreSQL EF migrations when installing with specified custom PostgreSQL schema name (this is an unsupported use case, but issues can be reported)
Repository CLI: For the export command, show correct usage message for –file option
Repository use correct serilog DiskLocation property name in dist appsettings
Portal: Show children of code lists when the code list is marked as a Copenhagen mapping classification
Colectica Designer¶
Added¶
Floating license server
Designer improve speed of local item search
Designer: Add editor for FundingPeriod, Add FundingPeriod to generated documentation
Designer code list import: support multiple languages for category labels and descriptions
Designer DataRelationship/LogicalRecord editor: add all Variables from a VariableGroup command
Handle Stata v6 (1999) types and system missing values
SPSS performance allow skipping some comparisons when computing if a double is defined missing
SPSS performance implement whole case reading and decoding, reuse case buffer, 4x speed improvement vs reading each column
Designer advanced command to generate a survey instrument from a dataset
Designer: allow Generate DDI 2 command on StudyUnits and PhysicalInstances
Designer Series editor: edit TypeOfGroup controlled vocabulary property
Designer metadata input sheet import: FrequenciesForValid FrequenciesForInvalid columns to set checkboxes
Designer metadata input sheet import: Additivity column to set Stock, Flow, or NonAdditive
Designer experimental import modified checkout, detecting differences, for INSEE
Changed¶
Designer item picker: Allow searching within parent items tagged as “ShowInItemPickerNavigation”.
Designer item picker: Show error message when connecting to a repository results in an error
Designer item picker: Remember most recently used repository and navigation item
Floating license server log reason for JWT validation failure
Designer show up to 5 decimal places for weighted frequencies
Designer display Frequency even when it is set to a weighted frequency
Summary statistic calculation: don’t compute minimum and maximum for text variables
Designer: for Code variables with underlying text data, consider values missing based on the CodeList
Data performance don’t box and unbox values when reading rows from SAS
Designer item picker: don’t show total number of results
- Designer Update from File command:
When removing variables, also remove from VariableGroups
When removing variables, also remove any VariableStatistics for that variable
Show user changes to be made and allow them to proceed or cancel;
Designer group views: sort items alphabetically by label or name.
Designer repository configuration: trim whitespace around URL and UserName.
Designer: Set default GuiLanguage to “en”
Designer metadata import command: trim whitespace from column headers
Remove Application Insights from desktop apps
dependency updates to allow running on net8
Designer remove Save Report button
Reporting use Best text instead of Current text in most locations
Designer statistics calculation: use populated code list to determine whether data are valid
Designer code value control: Only show combobox when fallback choices are specified
PDF generation: for datasets with Variable Groups, only output Variables once
Fixed¶
Stata handle invalid .dta files that have duplicate code values in the value label definitions
Designer single controlled vocabulary control: allow removing the value
Designer Parameters view: add a scroll bar and organize with tabs, to give more vertical space
Designer assign weight variable index correctly when using single column statistics computations
Designer stats calculation: don’t call GetDouble for missing text values
Handle text declared missing values on SPSS import
Designer CategoryGroup pseudo-classification correspondence map editor fixes
Designer fix when populating a sequence containing a coded question that has no code list
Colectica for Excel¶
Changed¶
Remove Application Insights from desktop apps
Excel update installer for new pdfsharp
Colectica Workflow¶
Added¶
Workflow use feature flags set for the source and target repository
add dockerfile for workflow web
Workflow task runner: process items in batches, instead of all at once, to reduce memory usage
Workflow Processes page: include process ID as hidden span
Changed¶
Workflow use global scoped mutex so single instance is also assured when running on linux
Workflow task runner: log before and after calling DeleteItemsAsync
Workflow: configure Serilog via appsettings, and use Serilog for request logging
changed platform to net8
Workflow replication: create checkout on target repository
Workflow task runner: When an exception occurs getting requests, don’t continue to process requests
Colectica Questionnaires¶
Changed¶
Questionnaires display logic editor: don’t show expression editor dropdowns when no subjects are available. Show a message instead.
Remove Application Insights from desktop apps
dependency updates to allow running on net8
Questionnaires: Hide “Tokens” button in Edit Check statements.
Questionnaires generate paper form in all instrument languages
Fixed¶
Questionnaires search into if/then/else and loops, not just sequences, when running FindNewSequenceViewModel after edits before returning not found
Questionnaires don’t drill into when encountering empty CustomSequenceViewModels
Questionnaires when looking for updated items, allow processing when duplicate items are present in the sequence
Questionnaires: fix for the parameter binding window failing to launch when a Code question did not have a code list assigned
Questionnaires allow selecting duplicate subjects to fulfill different inputs
Colectica SDK¶
Added¶
SDK add funding period to funding information
SDK add base Description to OtherMaterial
Changed¶
Repository CLI: command to update old PhysicalInstance CustomField VariableGroup references with real references
Net Core target changes from net6 to net8 due to upcoming end of life for Microsoft support
SDK performance: use hashset in metadata update builder
SDK allow get best culture to be local to a given asynchronous control flow
SDK enable warning as errors for Model and Model.Ddi
SDK fix identifiable objects not calling base methods for get/remove/replace children
SDK fix identifiable objects not using base custom fields and user attributes
SDK misc override fixes
SDK add documentation comments to all public and protected members
SDK add missing or extra arguments in documentation comments
Fixed¶
SDK don’t remove updated urn’s twice on import