55 Commits

Author	SHA1	Message	Date
gezimbll	3ebf3007a5	added startdelay config option for ers readers	2025-01-29 14:44:28 +01:00
ionutboangiu	d8acee74e2	Add *fileLineNumber var for file readers	2024-11-03 13:19:45 +01:00
ionutboangiu	63c1358c3f	Update behaviour of file readers using inotify ... Ensure that files already existing in the source path are processed before the reader starts listening for filesystem change events.	2024-09-23 20:28:26 +02:00
ionutboangiu	65e8128303	Implement ErSv1.RunReader api	2024-09-23 20:28:26 +02:00
ionutboangiu	e1adb674b8	Remove redundant dir parameter from processFile methods ... Applies to both file readers and loader (for loader, the blank statement was used anyway). It's redundant because for file readers, the rdr.sourceDir value was always passed as the parameter when it was already part of the method's object. Parameter had to also be removed from the WatchDir function and the functions it depends on.	2024-09-23 20:28:26 +02:00
ionutboangiu	7998ed6a0f	Extract common dir processing logic to a func ... It will be reused for all file readers. Rename rdrDir field to sourceDir.	2024-09-23 20:28:26 +02:00
arberkatellari	c7221f0d1e	Add reader id within the *vars in ERs	2024-08-12 18:34:50 +02:00
adi	5d23b6433f	Chanegd FileName consts into ers	2022-11-20 18:46:55 +01:00
ionutboangiu	4857245aa5	Use copy instead of loop + other staticcheck fixes	2022-07-15 09:28:57 +02:00
andronache98	ecdf5e54ea	Changed headers	2022-03-09 14:14:30 +01:00
andronache98	9ec56f5155	Changed headers	2022-03-09 14:14:30 +01:00
ionutboangiu	aa46b1eefd	Fix compilation errors after making ers opts into structs	2021-11-01 13:51:02 +02:00
Trial97	c28ac62968	Updated flatstore tests	2021-05-19 15:54:14 +02:00
Trial97	d868c0a5f0	Added partial reader	2021-05-19 15:54:14 +02:00
Trial97	f6863bad3e	Updated flatsore ers	2021-05-06 14:00:37 +02:00
Trial97	7aeeeec50c	Updated ers config	2021-05-04 20:45:09 +02:00
Trial97	e2e0e580fa	Added lazyQuotes option for csv reader	2021-04-26 16:03:46 +02:00
Trial97	8aa7009d36	Updated AttributesSv1 APIs	2021-04-13 13:35:03 +02:00
Trial97	2da495af19	Starting adding back AttributesSv1 APIs	2021-04-13 13:35:03 +02:00
Trial97	c13a5cf790	Finished implementing the DataNode as a replacement	2021-03-26 13:46:25 +01:00
Trial97	ba090352ec	Updated agents tests	2021-03-26 13:46:25 +01:00
Trial97	e52e8d7622	Added Length Field in case of NMSlice and support for multiple indexes in template path	2021-03-18 16:46:55 +01:00
Trial97	5353b95e43	Updated go version and replaced ioutil package	2021-03-18 16:46:55 +01:00
TeoV	2bfb234804	Update integration test in agents	2021-01-15 09:53:55 +01:00
TeoV	ae146640f4	Start merging CGREventWithOpts with CGREvent	2021-01-14 10:30:35 +01:00
andronache	36da1a6309	Consts in utils	2021-01-11 10:57:44 +01:00
Trial97	06e4fd13c3	Updated integration tests	2020-12-09 17:00:04 +01:00
Trial97	505f230b1e	Added inotify support for loaders	2020-11-11 15:06:35 +01:00
Trial97	deb57e190c	Updated ees service tests	2020-05-29 16:18:51 +02:00
Trial97	336e755d53	Added support to reference CSV fields by the column name. Fixes #2194	2020-05-29 16:18:51 +02:00
TeoV	24b2206a2a	Return error in case of filterS.Pass	2020-05-20 17:20:34 +02:00
Trial97	13e813f848	Fixed agents unit tests	2020-05-07 11:17:41 +02:00
Trial97	41e35bc571	Added Opts to APIs	2020-04-26 13:08:34 +02:00
adragusin	179067de5d	updated rounding method and RowLength	2020-04-02 16:54:03 +02:00
adragusin	16d25cc6cb	Added a new configuration option in ers, row_length	2020-04-02 16:54:03 +02:00
Trial97	f4e9d39558	Added the file name in *vars for csv,fwv,xml,flatstore and partial_csv event readers. Closes #407	2020-03-24 16:37:59 +01:00
TeoV	3e3fc6c457	Correctly populate ConcurrentRequest from config in EventReader fixes #1932	2020-02-18 14:24:50 +01:00
TeoV	b85ebe8214	Update EventReader integration tests	2020-02-05 15:57:58 +01:00
TeoV	52f0e0a86c	Merge ContentFields,HeaderFields,TrailerFields into one Files	2020-01-29 14:40:57 +01:00
TeoV	26ea469328	Merge content,header,trailer fields into fields	2020-01-29 14:40:57 +01:00
TeoV	c82c1c4866	Remove pathPrfx from sliceDP	2020-01-23 10:47:32 +02:00
adragusin	f9a79edfe3	replaced hard coded strings with const	2020-01-21 14:06:11 +02:00
TeoV	a2954c77c9	Finish updating integration test after modification	2019-11-27 11:10:32 -05:00
Trial97	41728e690a	Updated EventReader for CSV files to read only files with extension .csv	2019-11-20 14:55:09 +01:00
TeoV	8a9ac38536	Move csvProvider in config (SliceDP) and add ers in integration test script	2019-09-08 17:39:11 +02:00
TeoV	00d6e211e4	Add integration test for eventReader ( csv type )	2019-09-08 17:39:11 +02:00
DanB	55edb4f6f8	ERs with error handling via chans	2019-09-06 21:27:46 +02:00
DanB	8150199b78	CSVReader with default comma char	2019-09-04 12:29:40 +02:00
DanB	e3055c8d9f	EventReader with CSV in alpha	2019-09-04 12:24:25 +02:00
DanB	a144e9d8ea	CSVFileER with manual folder processing	2019-09-04 12:24:25 +02:00