Release 3.13 primarily introduces new Search Editor Portal (SEP) to Findwise i3. We decided to rewrite this service because it was the last one not based on i3 Blueprint framework. Therefore, we're addressing the technological debt while also opening SEP to new features related to managing search relevance (including RAG (Retrieval-augmented generation) approach!).
In general, SEP functionalities focus on synonym management, setting up sponsored results (both elevating indexed content and creating completely new one outside the search index), relevancy tests based on human judgments, a dictionary of values, and search analytics. It provides multiple dashboard view, role-based access, and an audit trail of changes.
New SEP has been built in plugin / microkernel architecture (and thus it's highly customizable to the needs). It's the first one that use Keycloak for authentication and authorization. The rest of the i3 services will follow that soon. In this release, we delivered Elasticsearch synonyms, elevates, and quicklinks features. The rest (dictionaries, aggregations, relevance tests, and Solr features) will be included in versions 3.14 and 3.15. The previous SEP is still available, and the new one is treated as an optional component. The new SEP will decommission the old one in the next major (4.0.0) version of i3.
Improvements
- New SEP epic with 60+ tickets, stories and tasks covering designing new architecture, security dependant on Keycloak / OpenID Connect, UI based on i3 Blueprint framework and React.js (replaced Thymeleaf), and Elasticsearch features.
- [FP-878] Change format of environment in docker compose to map
- For easier extension, format of environment variables in docker compose got changed to map. Now it's possible to e.g. set up relation between two services and change variables only in one place
- [FP-882] Enforce code-formatting at i3 project(s)
- Enforced code-formatting; i3 Reference was the main reason, however now all i3 core repositories follow it
- [FP-858] Upgrade key dependencies
- Upgraded Elasticsearch to 7.17.18, OpenSearch to 1.3.14, MongoDB to 4.4.27, Spring Boot to 2.7.18, Docker base image to 11.0.21_9-jre-jammy
- [FP-974] Upgrade vulnerable java dependencies
- Upgrading logback-classic & logback-core to 1.2.13, json-path to 2.8.0, zookeeper to 3.7.2, jetty/http2-hpack & jetty-http to 9.4.53, snappy-java high to 1.1.10.4, org.json to 20231013
Bug fixes
- [FP-840] Validation issue in Index4 configuration for MongoDB repo
- The problem and conflict with two validation methods has been resolved when the parameter authMechanism is used. Exception doesn't occur anymore when username and password is given directly
- [FP-839] Change password encryptor form input validation, so that it accepts special characters
- The password encryptor in i3 Search has been changed and now it accepts special characters
Removals
Versions of key components
- Elasticsearch 7.17.18
- Apache Solr 8.11.1
- OpenSearch 1.3.14
- MongoDB 4.4.27
- Neo4j 4.4.12
- Docker base image 11.0.21_9-jre-jammy
Changelog
- New SEP Skeleton: [FP-790] Feature form view issues Task
- Upgrade key dependencies & engines: [FP-858] Upgrade key dependencies Task
- [FP-806] IDs encoding in SinkService Bug
- [FP-974] Upgrade vulnerable java dependencies Task
- [FP-870] SEP3 - Tooltips Task
- New SEP Skeleton: [FP-790] Feature form view issues Task
- New SEP Skeleton: [FP-842] As a sep admin, I can assign users to a newly created dashboard Task
- Upgrade key dependencies & engines: [FP-858] Upgrade key dependencies Task
- [FP-817] Issue with storing a doc in MongoDB when ID matches the string representation of ObjectID Bug
- [FP-840] Validation issue in Index4 configuration for MongoDB repo Bug
- [FP-974] Upgrade vulnerable java dependencies Task
- New SEP Skeleton: [FP-790] Feature form view issues Task
- New SEP Skeleton: [FP-842] As a sep admin, I can assign users to a newly created dashboard Task
- Upgrade key dependencies & engines: [FP-858] Upgrade key dependencies Task
- [FP-692] Support the situation when blueprints_version.txt is missing Task
- [FP-974] Upgrade vulnerable java dependencies Task
Search Service 2.25.0
- New SEP Features: [FP-949] Implement communication client between search and SEP Task
- New SEP Features: [FP-914] New search feature for new SEP Elasticsearch Elevates Task
- New SEP Features: [FP-915] New search feature for new SEP quicklinks Task
- New SEP Skeleton: [FP-790] Feature form view issues Task
- New SEP Skeleton: [FP-842] As a sep admin, I can assign users to a newly created dashboard Task
- Upgrade key dependencies & engines: [FP-858] Upgrade key dependencies Task
- [FP-809] Broken ElasticDateHistogramFacetFeature after changing ES client Bug
- [FP-839] Change password encryptor form input validation, so that it accepts special characters Bug
- [FP-974] Upgrade vulnerable java dependencies Task
- [FP-1049] Update joda-time Task
Search Editor Portal 3.0.0
- New SEP Administrative stuff: [FP-838] Create MORE drop-down list with link to Swagger and user in authorization server Task
- New SEP Administrative stuff: [FP-888] Introduce SEP3 in Reference Task
- New SEP Administrative stuff: [FP-887] CICD automation for SEP3 Task
- New SEP Administrative stuff: [FP-918] Adjust security scopes in SEP3 API Task
- New SEP Administrative stuff: [FP-84] As a search editor, I can read SEP system info Story
- New SEP Features: [FP-80] As a search editor, I can use Elastic Elevates feature Story
- New SEP Features: [FP-849] As an admin, I can configure new Elasticsearch Synonyms Feature Story
- New SEP Features: [FP-78] As a search editor, I can use Quicklinks Story
- New SEP Features: [FP-902] Implement synonym synchronization with Elasticsearch to file with reloading using API Task
- New SEP Features: [FP-935] Fix blueprint form styles CSS Bug
- New SEP Features: [FP-872] Import/export entries for Resource features Task
- New SEP Features: [FP-801] As a search editor, I can use autocompletion in Elastic Elevates feature Story
- New SEP Features: [FP-916] Display real last mod date in the table with features at new SEP Task
- New SEP Features: [FP-914] New search feature for new SEP Elasticsearch Elevates Task
- New SEP Features: [FP-915] New search feature for new SEP quicklinks Task
- New SEP Skeleton: [FP-702] Figure out proper plugin approach in new SEP Task
- New SEP Skeleton: [FP-687] Introduce React in new SEP Task
- New SEP Skeleton: [FP-738] Establish testing scheme for new SEP Task
- New SEP Skeleton: [FP-748] As a developer, I have working CI in SEP3 Story
- New SEP Skeleton: [FP-749] Design and implement SEP plugins lifecycle Task
- New SEP Skeleton: [FP-70] As a SEP admin, I can manage SEP features Story
- New SEP Skeleton: [FP-730] CRUD dashboards backend Task
- New SEP Skeleton: [FP-688] Introduce security in new SEP Task
- New SEP Skeleton: [FP-754] Implement new SEP UI styles Task
- New SEP Skeleton: [FP-790] Feature form view issues Task
- New SEP Skeleton: [FP-750] Implement changelog mechanism for SEP Task
- New SEP Skeleton: [FP-69] As a SEP admin, I can manage SEP dashboards Story
- New SEP Skeleton: [FP-842] As a sep admin, I can assign users to a newly created dashboard Task
- New SEP Skeleton: [FP-830] Apply abstraction for Resource Feature Task
- New SEP Skeleton: [FP-831] Provide UserFacade implementation based on Spring Security Task
- New SEP Skeleton: [FP-845] Parametrize urls and ports of services in ServicesNavbar Task
- New SEP Skeleton: [FP-812] Update SEP documentation about security Task
- New SEP Skeleton: [FP-837] Dashboards available in configuration as code Bug
- New SEP Skeleton: [FP-834] Add 'description' property to Feature in SEP domain Task
- New SEP Skeleton: [FP-862] Handle current user on frontend site Task
- New SEP Skeleton: [FP-861] configuration page - assign dashboard to feature Task
- Upgrade key dependencies & engines: [FP-858] Upgrade key dependencies Task
- [FP-936] Setup CSRF for web-api endpoints Task
- [FP-703] Implement repository for features Task
- [FP-954] Elevates: New text area with number Bug
- [FP-956] CTRL+S keyboard shortcut is supposed to save UI forms like in other i3 services Task
- [FP-957] On feature page and its header show name of feature, not ID Bug
- [FP-977] SEP - sorting by 'trigger words' and 'document label(s)' don't work Bug
- [FP-955] Every deletion in UI (of feature, entry, dashboard...) must be confirmed first (are you sure...) Task
- [FP-974] Upgrade vulnerable java dependencies Task
- [FP-1040] Removing or saving multiple entries does not update statistics Bug
- [FP-870] SEP3 - Tooltips Task
- [FP-881] Update entry and resource feature relationship Task
- [FP-1044] Records are not saved when elasticsearch is disabled and autocompletion is enabled Bug
- [FP-1057] Unified strategy for configuration as code Task
- [FP-1056] Elevate help icon is missing Bug
- [FP-1047] Fix failed tests in sep3 Bug
- [FP-1048] Check why pipeline does not run all tests Bug
Search Editor Portal 2.19.0
- New SEP Skeleton: [FP-657] Introduce Blueprint system in new SEP Task
- Upgrade key dependencies & engines: [FP-858] Upgrade key dependencies Task
- [FP-974] Upgrade vulnerable java dependencies Task
Reference 3.13.0
- New SEP Administrative stuff: [FP-888] Introduce SEP3 in Reference Task
- New SEP Administrative stuff: [FP-887] CICD automation for SEP3 Task
- New SEP Features: [FP-914] New search feature for new SEP Elasticsearch Elevates Task
- New SEP Skeleton: [FP-690] Introduce keycloack in Reference Task
- New SEP Skeleton: [FP-831] Provide UserFacade implementation based on Spring Security Task
- New SEP Skeleton: [FP-812] Update SEP documentation about security Task
- [FP-810] Add slf4j-api dependency to plugins in Reference Task
- [FP-878] Review MR Change format of environment in docker compose to map Task
Parent 3.13.0
- New SEP Administrative stuff: [FP-888] Introduce SEP3 in Reference Task
- Upgrade key dependencies & engines: [FP-858] Upgrade key dependencies Task
- [FP-974] Upgrade vulnerable java dependencies Task
Commons 1.20.0
- New SEP Features: [FP-914] New search feature for new SEP Elasticsearch Elevates Task
- New SEP Skeleton: [FP-657] Introduce Blueprint system in new SEP Task
- New SEP Skeleton: [FP-730] CRUD dashboards backend Task
- New SEP Skeleton: [FP-750] Implement changelog mechanism for SEP Task
- New SEP Skeleton: [FP-842] As a sep admin, I can assign users to a newly created dashboard Task
- New SEP Skeleton: [FP-845] Parametrize urls and ports of services in ServicesNavbar Task
- Upgrade key dependencies & engines: [FP-858] Upgrade key dependencies Task
Questions? Please reach out to findwise.i3.dev@tietoevry.com