60 Commits

Author SHA1 Message Date
ionutboangiu
8443af3a89 Relicense from GPLv3 to AGPLv3 2025-10-29 19:42:40 +01:00
gezimbll
3974192787 added asynchronus startdelay for file readers and nats 2024-11-26 11:20:40 +01:00
gezimbll
e48eb5df13 added StartDelay for ers processing 2024-11-15 20:58:10 +01:00
gezimblliku
ccc999642d added *fileLineNumber variable 2024-08-22 20:40:46 +02:00
arberkatellari
0bab7d5557 Add reader id within the *vars in ERs 2024-08-09 09:14:24 +02:00
gezimbll
5f941b1f9d changed conReqs to not populate buffer at start 2024-04-24 17:09:54 +02:00
ionutboangiu
5c1e128f4f Update behaviour of file readers using inotify
Ensure that files already existing in the source path are processed
before the reader starts listening for filesystem change events.
2024-04-04 12:31:18 +03:00
ionutboangiu
a362511d7a Define param struct for ErSv1.RunReader API + refactoring
Rename dir field to sourceDir in file event readers for clarity.
2024-04-04 12:31:18 +03:00
ionutboangiu
b9b07dc561 Remove redundant dir parameter from processFile methods
Applies to both file readers and loader (for loader, the blank statement
was used anyway).

It's redundant because for file readers, the rdr.dir value was always
passed as the parameter when it was already part of the method's object.

Parameter had to also be removed from the WatchDir function and the
functions it depends on.
2024-04-04 12:31:18 +03:00
ionutboangiu
85864ccaa3 Extract common dir processing logic to a func
It will be reused for all file readers.
Rename rdrDir field to dir (redundant prefix).
2024-04-04 12:31:18 +03:00
ionutboangiu
0aea8ac641 Revert "Move CGREvent from utils to engine"
This reverts commit 02195c47ed.
2024-03-04 09:49:15 +01:00
ionutboangiu
02195c47ed Move CGREvent from utils to engine 2024-02-27 17:16:57 +01:00
ionutboangiu
a80fe9b96e Remove redundant prefixes/suffixes from rOpts field names 2023-09-28 20:48:07 +02:00
gezimbll
01d3c5d0fa Separating opts in ERS && fixing tests 2023-06-27 11:08:34 +02:00
adi
ad8470a805 Changed FileName into ers+configs 2022-11-20 18:46:17 +01:00
ionutboangiu
38447e9229 Make ers opts as struct and fix compilation errors 2021-11-29 20:57:39 +01:00
Trial97
73de017591 Updated flatstore tests 2021-05-17 18:00:31 +02:00
Trial97
cae5b4ced5 Added partial reader 2021-05-17 18:00:31 +02:00
Trial97
d53b6175d5 Updated flatsore ers 2021-05-17 18:00:31 +02:00
Trial97
5105d3aa85 Updated ers config 2021-05-17 18:00:31 +02:00
Trial97
13cd8e8a99 Added lazyQuotes option for csv reader 2021-04-26 16:03:09 +02:00
nickolasdaniel
b451279779 Coverage tests for ers 2021-04-26 13:08:22 +02:00
nickolasdaniel
0d281ae5c9 Coverage tests for ers and fixed EOF error bug in filecsv.go 2021-04-22 10:44:50 +02:00
Trial97
1d67bca260 Updated tests after remove 2021-04-01 16:33:37 +02:00
Trial97
c13a5cf790 Finished implementing the DataNode as a replacement 2021-03-26 13:46:25 +01:00
Trial97
ba090352ec Updated agents tests 2021-03-26 13:46:25 +01:00
Trial97
e52e8d7622 Added Length Field in case of NMSlice and support for multiple indexes in template path 2021-03-18 16:46:55 +01:00
Trial97
5353b95e43 Updated go version and replaced ioutil package 2021-03-18 16:46:55 +01:00
TeoV
2bfb234804 Update integration test in agents 2021-01-15 09:53:55 +01:00
TeoV
ae146640f4 Start merging CGREventWithOpts with CGREvent 2021-01-14 10:30:35 +01:00
andronache
36da1a6309 Consts in utils 2021-01-11 10:57:44 +01:00
Trial97
06e4fd13c3 Updated integration tests 2020-12-09 17:00:04 +01:00
Trial97
505f230b1e Added inotify support for loaders 2020-11-11 15:06:35 +01:00
Trial97
deb57e190c Updated ees service tests 2020-05-29 16:18:51 +02:00
Trial97
336e755d53 Added support to reference CSV fields by the column name. Fixes #2194 2020-05-29 16:18:51 +02:00
TeoV
24b2206a2a Return error in case of filterS.Pass 2020-05-20 17:20:34 +02:00
Trial97
13e813f848 Fixed agents unit tests 2020-05-07 11:17:41 +02:00
Trial97
41e35bc571 Added Opts to APIs 2020-04-26 13:08:34 +02:00
adragusin
179067de5d updated rounding method and RowLength 2020-04-02 16:54:03 +02:00
adragusin
16d25cc6cb Added a new configuration option in ers, row_length 2020-04-02 16:54:03 +02:00
Trial97
f4e9d39558 Added the file name in *vars for csv,fwv,xml,flatstore and partial_csv event readers. Closes #407 2020-03-24 16:37:59 +01:00
TeoV
3e3fc6c457 Correctly populate ConcurrentRequest from config in EventReader fixes #1932 2020-02-18 14:24:50 +01:00
TeoV
b85ebe8214 Update EventReader integration tests 2020-02-05 15:57:58 +01:00
TeoV
52f0e0a86c Merge ContentFields,HeaderFields,TrailerFields into one Files 2020-01-29 14:40:57 +01:00
TeoV
26ea469328 Merge content,header,trailer fields into fields 2020-01-29 14:40:57 +01:00
TeoV
c82c1c4866 Remove pathPrfx from sliceDP 2020-01-23 10:47:32 +02:00
adragusin
f9a79edfe3 replaced hard coded strings with const 2020-01-21 14:06:11 +02:00
TeoV
a2954c77c9 Finish updating integration test after modification 2019-11-27 11:10:32 -05:00
Trial97
41728e690a Updated EventReader for CSV files to read only files with extension .csv 2019-11-20 14:55:09 +01:00
TeoV
8a9ac38536 Move csvProvider in config (SliceDP) and add ers in integration test script 2019-09-08 17:39:11 +02:00