CHANGES.md 6.65 KB
Newer Older
Pablo Panero's avatar
Pablo Panero committed
1
2
Changes
=======
Carina Antunes's avatar
Carina Antunes committed
3

Carina Antunes's avatar
Carina Antunes committed
4
5
6
7
8
9
10
**Version 1.8.2-beta (released 2020-06-15)**

Changes:

- [EDMS] Update mappings shards

----
Carina Antunes's avatar
Carina Antunes committed
11
12
13
14
15
16

**Version 1.8.1-beta (released 2020-06-14)**

Changes:

- Lock invenio-db @ https://github.com/carantunes/invenio-db/commit/1f0901ae2eeaef1dc709fe1f6fc628f87a1866e4 (Fix https://github.com/kvesteri/sqlalchemy-continuum/issues/187)
Carina Antunes's avatar
Carina Antunes committed
17
- [EDMS] Update mappings
Carina Antunes's avatar
Carina Antunes committed
18
19
20

----

Carina Antunes's avatar
Carina Antunes committed
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
**Version 1.8.0-beta (released 2020-06-10)**

Changes:

- Add indico and lcagenda filters and schemas
- Improve error handling
- Celery improvements: logging and worker_proc_alive_timeout
- Add index to records buckets
- Config CERN_SEARCH_PROCESS_FILE_META can be a bool or a list of fields
- New config CERN_SEARCH_COPY_TO_METADATA allows copying stored fields to metadata
- Add nested filter facet
- Support gzip access list
- Support default operator query param

----

Carina Antunes's avatar
Carina Antunes committed
37
38
39
40
41
42
43
44
45
**Version 1.7.0-beta (released 2020-04-07)**

Changes:

- Decrease max file content size to 1MB
- [EDMS] Document mapping weights update

----

Carina Antunes's avatar
Carina Antunes committed
46
47
48
49
50
51
52
53
54
**Version 1.6.1-beta (released 2020-01-19)**

Changes:

- ES timeout configurable
- New query parameter: exclude (ES source filtering)

----

Carina Antunes's avatar
Carina Antunes committed
55
56
57
58
59
60
61
62
63
64
**Version 1.6.0-beta (released 2020-12-10)**

Changes:

- Switch from pipenv to poetry
- Fix linting
- Bump python version 3.8

----

Carina Antunes's avatar
Carina Antunes committed
65
66
67
68
69
70
**Version 1.5.0-beta (released 2020-12-08)**

Changes:
- [SEARCH-108] Facets: querystring + url filter
- [SEARCH-114] Limit access to alias instances GET /records
- Add Indico schemas and aggregations
Carina Antunes's avatar
Carina Antunes committed
71
72
- [SEARCH-107] Switch to new cern oauth
- [SEARCH-115] refactor archives (add discourse and notifications archives)
Carina Antunes's avatar
Carina Antunes committed
73
74
75

----

Carina Antunes's avatar
Carina Antunes committed
76
77
78
79
**Version 1.4.0-beta (released 2020-09-08)**

Changes:

Carina Antunes's avatar
Carina Antunes committed
80
- [SEARCH-86] Bump to Invenio 3.3
Carina Antunes's avatar
Carina Antunes committed
81
82
83
- [NI] Generate certificate with a Certificate Authority

----
Carina Antunes's avatar
Carina Antunes committed
84
85
**Version 1.3.3-beta (released 2020-08-31)**

Carina Antunes's avatar
Carina Antunes committed
86
87
88
89
90
91
Changes:

- Revert release 1.3.2 and 1.3.1
- [SEARCH-102] EDMS schemas updates
- Limit content of files on ~100MB

Carina Antunes's avatar
Carina Antunes committed
92
----
Carina Antunes's avatar
Carina Antunes committed
93
94
**Version 1.3.2-beta (released 2020-08-20)**

Carina Antunes's avatar
Carina Antunes committed
95
96
97
98
Changes:

- [NI] Add sentry-sdk dependency

Carina Antunes's avatar
Carina Antunes committed
99
----
Carina Antunes's avatar
Carina Antunes committed
100
**Version 1.3.1-beta (released 2020-08-18)**
Carina Antunes's avatar
Carina Antunes committed
101

Carina Antunes's avatar
Carina Antunes committed
102
103
104
105
Changes:

- [SEARCH-86] Upgrade to invenio 3.3

Carina Antunes's avatar
Carina Antunes committed
106
----
Carina Antunes's avatar
Carina Antunes committed
107
108
109
110
111
112
113
114
115
116
117
118
119
**Version 1.3.0-beta (released 2020-07-06)**

Changes:
- [SEARCH-96] JACoW filters and metadata
    - Support file metadata extraction and indexing
         - authors, keywords, creation date, content type and title
    - Webservices filters and facets:
         - aggs: authors, sites, keywords
         - filters: author, site, keyword
         - matches: author_match, keyword_match, site_match
- [SEARCH-92] Add codimd schemas
- [NI] Add openshift-dev CI

Carina Antunes's avatar
Carina Antunes committed
120
----
Carina Antunes's avatar
Carina Antunes committed
121

Carina Antunes's avatar
Carina Antunes committed
122
123
124
125
126
127
128
129
130
131
132
133
134
**Version 1.2.1-beta (released 2020-05-28)**

Changes:
- [SEARCH-79] EDMS: schemas improvements
- [NI] Add options to reindex cli
    - add option to reindex by id: `invenio utils reindex -i <id>`
    - option to set chunk size: `invenio utils runindex -s 10`
    - option to reindex by doc type: `invenio utils runindex -d doc_v0.0.2`
- [SEARCH-88] Filters improvements - apply to aggregations
- [SEARCH-88] Permissions improvements
    - Make public records available without login
    - Only view admin accounts can use the access query param

Carina Antunes's avatar
Carina Antunes committed
135
----
Carina Antunes's avatar
Carina Antunes committed
136

Carina Antunes's avatar
Carina Antunes committed
137
138
139
140
141
142
143
144
**Version 1.2-beta (released 2020-05-14)**

Changes:
- [SEARCH-85] Fix reindex cli
    - Instead of `invenio index reindex -t recid` now should use `invenio utils reindex -t recid`
    - Instead of `invenio index run` now should use `invenio utils runindex`
- [NI] fix indico jonschemas

Carina Antunes's avatar
Carina Antunes committed
145
----
Carina Antunes's avatar
Carina Antunes committed
146

Carina Antunes's avatar
Carina Antunes committed
147
148
149
150
151
152
**Version 1.1.2-beta (released 2020-05-14)**

Changes:
- Update full compose
- [SEARCH-67] Remove binary mappings

Carina Antunes's avatar
Carina Antunes committed
153
----
Carina Antunes's avatar
Carina Antunes committed
154

Carina Antunes's avatar
Carina Antunes committed
155
156
157
158
159
160
161
**Version 1.1.1-beta (released 2020-04-28)**

Changes:
- [SEARCH-72] Fix too_many_clauses error

----

Carina Antunes's avatar
Carina Antunes committed
162
163
164
165
166
167
168
**Version 1.1.0-beta (released 2020-04-28)**

Changes:
- [SEARCH-67] Migrate to ES v7

----

169
170
171
172
173
174
175
**Version 1.0.9-beta (released 2020-04-16)**

Changes:
- [SEARCH-71] egroupsarchives: make group searchable

----

Carina Antunes's avatar
Carina Antunes committed
176
177
178
179
180
181
182
183
**Version 1.0.8-beta (released 2020-04-14)**

Changes:
- [SEARCH-70] Add field to egroups archives

----


Carina Antunes's avatar
Carina Antunes committed
184
**Version 1.0.7-beta (released 2020-04-07)**
Pablo Panero's avatar
Pablo Panero committed
185

Carina Antunes's avatar
Carina Antunes committed
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
Changes:
- [SEARCH-69] Multifields type search parameter


----

**Version 1.0.6-beta (released 2020-04-06)**

Changes:
- [egroupsarchives] Update archive_v1.0.0.json

----

**Version 1.0.5-beta (released 2020-04-06)**

Changes:
- [SEARCH-66] Add highlight and explain params to search api

----

**Version 1.0.4-beta (released 2020-04-03)**

Changes:
- [SEARCH-60] Egroups Archives mapping fix
- [SEARCH-68] Improve score calculations

----

**Version 1.0.3-beta (released 2020-04-02)**

Changes:
- [SEARCH-60] Add egroups archives schemas

----

**Version 1.0.2-beta (released 2020-03-23)**
Carina Antunes's avatar
Carina Antunes committed
222
223

Changes:
Carina Antunes's avatar
Carina Antunes committed
224
- [SEARCH-47] Bump tika to 1.24
Carina Antunes's avatar
Carina Antunes committed
225

Carina Antunes's avatar
Carina Antunes committed
226
227
228
----

**Version 1.0.1-beta (released 2020-03-19)**
Carina Antunes's avatar
Carina Antunes committed
229
230
231
232

Changes:
- [SEARCH-42] Bump invenio-records to 1.2.2 - security vulnerability

Carina Antunes's avatar
Carina Antunes committed
233
----
Carina Antunes's avatar
Carina Antunes committed
234

Carina Antunes's avatar
Carina Antunes committed
235
**Version 1.0.0-beta (released 2020-03-17)**
Carina Antunes's avatar
Carina Antunes committed
236
237
238

Changes:

Carina Antunes's avatar
Carina Antunes committed
239
- [SEARCH-1] File indexing via Tika + remove support for OCR extraction via ES pipelines
Carina Antunes's avatar
Carina Antunes committed
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
- [#94] Fix rate limit configuration
- [#91] CI: refactor to dev, test and prod usecase
- [#85] EDMS: file v5
- [#88] Files: implement file upload
- [#77] Tests: Run on CI against local changes
- [#83] Mappings: add edms objects
- [#48] Permissions: make schema owner configurable and refactor logic
- [#79] Automate linting
- [#82] Build: bugfixes and improvements
- [#53] Create docker-compose environments
- [#68] Improvements on EDMS documents schema
- [EDMS] config: add sorting options for cernsearchqa-edms
- [EDMS] mappings: new versions
- [TEST] mappings: refactor search-as-you-type analyzer and add did-you-mean
- [WEBSERVICES] mappings: add suggest field for search-as-you-type
- [TEST] mappings: add suggest schema

Carina Antunes's avatar
Carina Antunes committed
257
258
259
260

----

**Version 0.7.0 (released 2019-05-31)**
Pablo Panero's avatar
Pablo Panero committed
261
262
263
264
265
266
267
268
269
270
271
272
273
274

Features:

- Refactor folders hierarchy
- Created datamodel convention for searchable data (_data)
- Improve Webservices Mappings
- Upgrade to ES6
- Enable OCR extraction in ES
- Migrate to Python3
- Migrate to Pipenv
- Split docker images (Base and App)

----

Carina Antunes's avatar
Carina Antunes committed
275
**Version 0.6.0 (released 2018-01-17)**
Pablo Panero's avatar
Pablo Panero committed
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290

Features:

- Refactor access patter to allow cascade.
- Add health check endpoint to web app.
- Add licensing.
- Add schema validation.

Fixes:

- Change ``_access`` mappings field from type nested to object for performance reasons.
- Setup.py versions.

----

Carina Antunes's avatar
Carina Antunes committed
291
**Version 0.5.3 (released 2018-11-13)**
Pablo Panero's avatar
Pablo Panero committed
292
293
294
295
296
297
298
299
300
301
302

Features:

- Add an endpoint to perform ``Update By Query`` actions over single documents.
- Add ``document_v1.0.0`` schema for EDMS instance.
- Add ``Health`` blueprint with three possible endpoints (uWSGI, Elasticsearch and database).
- Make ``access`` parameter optional in requests.
- Make optional the use of CERN e-groups for permissions.

Fixes:

Carina Antunes's avatar
Carina Antunes committed
303
- Document creation should just check if the user is authenticated in the first iteration. Permissions over the schema are checked on the second iteration.