I have collibra data governance set up in my company and I am trying to download dataset from it using API. I am not able find any tutorial/link which can explain how to use API to download files collibra using script. Any where I see it shows how to import into collibra and not export.
Any guidance/link will be highly appreciated.
In REST Core APIs, Output Module can be used to export as JSON, CSV, Excel and XML. Kindly refer this, https://developer.collibra.com/rest/rest-core-api/
And also follow Hitchhiker’s Guide to the Output Module documentation for more info on how to create TableViewConfig/ViewConfig. https://developer.collibra.com/rest/output-module/
Related
I am new to the misp platform and I need a dataset that I can feed to a neural network for malware detection, the problem is I don't know how to export the events from my misp instance to a csv file using the api (because in the interface exports I can't find misp_context in the downloaded csv file)? can anyone help, thanks already.
Can you please let me know the best approach to migrate product image data in hybris . Should this be done using impex or is there any other convenient approach?
Here, you can find the approach to migrate your data. But you might struggle to implement it.
If you really not bother about URL changes after importing media/image then I would suggest using Hybris OOTB import/export wizard(System > Tools > Import / Export), where you can generate the export script for any ItemType and you can reImport generated Impex & media into the target system.
Like
# ---- Extension: core ---- Export Type: Media ----
"#% impex.setTargetFile( ""Media.csv"" );"
insert_update Media;&Item;#media[translator=de.hybris.platform.impex.jalo.media.MediaDataTranslator];altText;catalog(id)[allownull=true];catalogVersion(catalog(id),version)[unique=true,allownull=true];code[unique=true,allownull=true];convertedMedias(catalogVersion(catalog(id),version),code);dataPK;deniedPrincipals(uid);derivedMedias(&Item);description;internalURL;location;locationHash;mediaContainer(catalogVersion(catalog(id),version),qualifier);mediaFormat(qualifier);metaData(&Item);metaDataDataPK;mime;original(catalogVersion(catalog(id),version),code);originalDataPK;permittedPrincipals(uid);realFileName;removable[allownull=true];size;subFolderPath;supercategories(catalogVersion(catalog(id),version),code)
"#% impex.exportItemsFlexibleSearch( ""SELECT {PK} FROM {Media!} WHERE {catalogVersion} IN (8796054355417)"");"
In above script, you can change the query to get only image media.
Also, there is one advancedexport extension available to serve the same purpose with some additional functionality.
You have to deal with Extract & Transform and Load phase on your own based on your business requirement.
I'm pretty new on Jedox, and I'm trying for internal use to export some specific "warning logs" (eg. "(Mapping missing)" ) into an excel/wss file.
And I don't how to do that...
Can you help me please.
Regards,
Usik
The easiest way to get these information is to use the Integrator in Jedox.
There you have the possibility to use a File Extract and then you can filter the information you are searching for.
After that it's possible to load these filtered information into a File.
The minimum steps you'll need are Connection -> Extract -> Transform -> Load.
Please take a look at the sample projects that are delivered with the Jedox software. In the example "sampleBiker", there are also file connections, extracts etc.
You can find more samples in:
<Install_path>\tomcat\webapps\etlserver\data\samples
I recommend to check the Jedox Knowledgebase.
The other way (and maybe more flexible way) would be to use, for example, a PHP macro inside of a Jedox Web report and read the log file you're trying to display.
If you've got a more specific idea what you'd like to do, please let me know and I'll try to give you an example how to do so.
Has anyone done automation of extract/exporting data from Rally. Right now I log into rally and export data manually. I want to be able to automate it.
Can you please help me by pointing out to the right links or maybe provide me with some sample code.
I want to learn so more the info the better.
Regards,
Subro
This repo contains code that will export attachments... perhaps it could be used as a starting/learning point:
https://github.com/RallyTools/Rally-Export-Attachments
I am using the the google cloud logging web ui to export google compute engine logs to a big query dataset. According to the docs, you can even create the big query dataset from this web ui (It simply asks to give the dataset a name). It also automatically sets up the correct permissions on the dataset.
It seems to save the export configuration without errors but a couple of hours have passed and I don't see any tables created for the dataset. According to the docs, exporting the logs will stream the logs to big query and will create the table with the following template:
my_bq_dataset.compute_googleapis_com_activity_log_YYYYMMDD
https://cloud.google.com/logging/docs/export/using_exported_logs#log_entries_in_google_bigquery
I can't think of anything else that might be wrong. I am the owner of the project and the dataset is created in the correct project (I only have one project).
I also tried exporting the logs to a google storage bucket and still no luck there. I set the permissions correctly using gsutil according to this:
https://cloud.google.com/logging/docs/export/configure_export#setting_product_name_short_permissions_for_writing_exported_logs
And finally I made sure that the 'source' I am trying to export actually has some log entries.
Thanks for the help!
Have you ingested any log entries since configuring the export? Cloud Logging only exports entries to BigQuery or Cloud Storage that arrive after the export configuration is set up. See https://cloud.google.com/logging/docs/export/using_exported_logs#exported_logs_availability.
You might not have given edit permission for 'cloud-logs#google.com' in the Big Query console. Refer this.