Commit Graph

40 Commits

Author SHA1 Message Date
gezimbll
3974192787 added asynchronus startdelay for file readers and nats 2024-11-26 11:20:40 +01:00
gezimbll
e48eb5df13 added StartDelay for ers processing 2024-11-15 20:58:10 +01:00
ionutboangiu
769293d4db XML rdr: use rowNr instead of reqVars for line nr 2024-09-26 17:33:16 +02:00
gezimblliku
ccc999642d added *fileLineNumber variable 2024-08-22 20:40:46 +02:00
arberkatellari
0bab7d5557 Add reader id within the *vars in ERs 2024-08-09 09:14:24 +02:00
gezimbll
5f941b1f9d changed conReqs to not populate buffer at start 2024-04-24 17:09:54 +02:00
ionutboangiu
5c1e128f4f Update behaviour of file readers using inotify
Ensure that files already existing in the source path are processed
before the reader starts listening for filesystem change events.
2024-04-04 12:31:18 +03:00
ionutboangiu
a362511d7a Define param struct for ErSv1.RunReader API + refactoring
Rename dir field to sourceDir in file event readers for clarity.
2024-04-04 12:31:18 +03:00
ionutboangiu
b9b07dc561 Remove redundant dir parameter from processFile methods
Applies to both file readers and loader (for loader, the blank statement
was used anyway).

It's redundant because for file readers, the rdr.dir value was always
passed as the parameter when it was already part of the method's object.

Parameter had to also be removed from the WatchDir function and the
functions it depends on.
2024-04-04 12:31:18 +03:00
ionutboangiu
85864ccaa3 Extract common dir processing logic to a func
It will be reused for all file readers.
Rename rdrDir field to dir (redundant prefix).
2024-04-04 12:31:18 +03:00
ionutboangiu
0aea8ac641 Revert "Move CGREvent from utils to engine"
This reverts commit 02195c47ed.
2024-03-04 09:49:15 +01:00
ionutboangiu
02195c47ed Move CGREvent from utils to engine 2024-02-27 17:16:57 +01:00
ionutboangiu
6c41ebe0de Add sanity check to prevent xml reader panic
HierarchyPath parser now returns nil when
the path is empty (instead of a string slice with one
EmptyString element).

If the prefix is set to true, when calling the AsString
method on a nil HierarchyPath, only the separator will
be returned. This avoids a nil expr error coming from
the xmlquery library.

Use the Query and QueryAll functions from the xmlquery
package to be able to handle the errors ourselves and
avoid panics.

Remove config default value for xml_root_path. The field
will remain commented in config_defaults for reference.

Add tests for HierarchyPath.AsString function.

Add comments for XmlProvider and xml_root_path opt.
2023-10-16 13:18:12 +03:00
adi
ad8470a805 Changed FileName into ers+configs 2022-11-20 18:46:17 +01:00
ionutboangiu
38447e9229 Make ers opts as struct and fix compilation errors 2021-11-29 20:57:39 +01:00
Trial97
73de017591 Updated flatstore tests 2021-05-17 18:00:31 +02:00
Trial97
cae5b4ced5 Added partial reader 2021-05-17 18:00:31 +02:00
Trial97
d53b6175d5 Updated flatsore ers 2021-05-17 18:00:31 +02:00
Trial97
5105d3aa85 Updated ers config 2021-05-17 18:00:31 +02:00
Trial97
1d67bca260 Updated tests after remove 2021-04-01 16:33:37 +02:00
Trial97
c13a5cf790 Finished implementing the DataNode as a replacement 2021-03-26 13:46:25 +01:00
Trial97
ba090352ec Updated agents tests 2021-03-26 13:46:25 +01:00
Trial97
e52e8d7622 Added Length Field in case of NMSlice and support for multiple indexes in template path 2021-03-18 16:46:55 +01:00
Trial97
5353b95e43 Updated go version and replaced ioutil package 2021-03-18 16:46:55 +01:00
TeoV
2bfb234804 Update integration test in agents 2021-01-15 09:53:55 +01:00
TeoV
906baa051a Build success 2021-01-14 10:30:35 +01:00
Trial97
06e4fd13c3 Updated integration tests 2020-12-09 17:00:04 +01:00
Trial97
c539800acd Added more Clone functions for config sections 2020-11-27 08:41:56 +01:00
Trial97
2b19127d05 Added more Clone functions for config sections 2020-11-27 08:41:56 +01:00
Trial97
505f230b1e Added inotify support for loaders 2020-11-11 15:06:35 +01:00
TeoV
24b2206a2a Return error in case of filterS.Pass 2020-05-20 17:20:34 +02:00
Trial97
13e813f848 Fixed agents unit tests 2020-05-07 11:17:41 +02:00
Trial97
41e35bc571 Added Opts to APIs 2020-04-26 13:08:34 +02:00
Trial97
f4e9d39558 Added the file name in *vars for csv,fwv,xml,flatstore and partial_csv event readers. Closes #407 2020-03-24 16:37:59 +01:00
TeoV
3e3fc6c457 Correctly populate ConcurrentRequest from config in EventReader fixes #1932 2020-02-18 14:24:50 +01:00
TeoV
b85ebe8214 Update EventReader integration tests 2020-02-05 15:57:58 +01:00
TeoV
52f0e0a86c Merge ContentFields,HeaderFields,TrailerFields into one Files 2020-01-29 14:40:57 +01:00
TeoV
26ea469328 Merge content,header,trailer fields into fields 2020-01-29 14:40:57 +01:00
TeoV
f74df27ddd Remove pathPrfx from xmlDP 2020-01-23 10:56:30 +02:00
TeoV
4ea9cd3a48 Add XML to EventReader and test for it 2020-01-11 14:52:37 +02:00