dataverse

  • pdurbin
    I know right
  • pdurbin
    My daughter is stage crew for her 8th grade musical, Finding Nemo Jr., premiering two hours from now! I'm off! Have a great weekend! 🐟️
  • imlostlmao joined the room
  • tosigus joined the room
  • Don Sizemore
    D
    @poikilotherm dataverse.files.directory is only used for temporary files these days, correct? I'm asking because I ran across target/classes/META-INF/microprofile-config.properties:dataverse.files.directory=/tmp/dataverse
  • poikilotherm (CEST,UTC+2)
    No it's not!
  • There is a list in the docs where this stuff is used
  • (I asked myself the same thing when going for Mpconfig)
  • This is a sane default for most installations and development
  • Btw this directory is the default which had been present in the code before as well
  • pdurbin
    a pre-existing condition 🤒
  • Don Sizemore
    D
    @poikilotherm if u hapi i'm hapi, just double-checking
  • pdurbin
    Awesome thread about running Dataverse in containers for API testing: https://dataverse.zulipchat.com/#narrow/stream/377090-python/topic/containers.20for.20API.20testing
  • pdurbin
    Community call in a little under 3 hours, including a demo of Pooch! https://dataverse.org/community-calls
  • pdurbin
  • zbenta
    Z
    Pooch looks promissing, it would be great if we could download all the files, metadata and permissions associated with a said dataset and upload them to a different dataverse instance.
  • zbenta
    Z
    We asked our CERT team to do a blackbox security check of our dataverse installation, they found two vulnerabilities, one regarding the jQuery UI 1.13.0 version (https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-31160) and another regarding the absence of Anti-CSRF tokens. Should we create an issue
    P
    pdurbin
    ? The version of dataverse we are using is v5.13.
  • pdurbin
  • Z
    zbenta
    : as for moving datasets from one installation to another, I believe this is now possible using the BagIt format.
  • pdurbin

    This message is being deleted (typo)…

  • zbenta
    Z

    zbenta: yuck. Can you please email our security address? https://guides.dataverse.org/en/5.13/installation/config.html#reporting-security-issues

    I'll do so.

  • pdurbin
    Thanks!
  • zbenta
    Z
    Dataverse also has an issue with the session cookie being sent in cleartext, we tried using a session cookie from a coleague in my browser and I was able to impersonate him.
  • pdurbin
    Z
    zbenta
    : please email security about that too
  • Z
    zbenta
    : also, this channel is logged so it's not the best place to talk about security 😅
  • zbenta
    Z

    Dataverse also has an issue with the session cookie being sent in cleartext, we tried using a session cookie from a coleague in my browser and I was able to impersonate him.

    You can skip this one, it was a misunderstanding, as fot the others, we have sent an email regarding the issues.

  • *

    Dataverse also has an issue with the session cookie being sent in cleartext, we tried using a session cookie from a coleague in my browser and I was able to impersonate him.

    You can skip this one, it was a misunderstanding, as for the others, we have sent an email regarding the issues.

  • pdurbin
    Thanks!
  • Z
    zbenta
    : I can also give you access to https://github.com/IQSS/dataverse-security/issues if you like. Please just let me know.
  • zbenta
    Z
    Sure thing, why not
  • pdurbin
    Z
    zbenta
    : done! Do you see an invite at https://github.com/IQSS ?
  • Santiago Florez joined the room
  • Santiago Florez
    S
    Hello everyone
    I want to change the way to display the metadata citation in the subject field. I need the field to be displayed in URL format. I've been thinking about editing the tsv.
  • pdurbin
    S
    Santiago Florez
    : if you get it working, please open a pull request! ❤️
  • Do you have a screenshot or a mockup of how you would like it to look?
  • Santiago Florez
    S
    Yes, hold on a moment
  • dataverse.png
  • pdurbin
    Interesting. And where does "Chemistry" link to?
  • Santiago Florez
    S
    when I click on it, I search for that metadata in all Dataverses and datasets.
  • pdurbin
    I see
  • Santiago Florez
    S
    i´ve modified the displayFormat in the tsv to "<a href='/dataverse/#{dataverse.alias}?q=""#VALUE""' target=""_blank"" rel=""noopener"">#VALUE</a>"
  • pdurbin
    And maybe the same for author. If you click an author, you see all the datasets by that author?
  • Santiago Florez
    S
    Noup, I just need to change that field
  • And I've tried running solr's update***.sh. I don't know if I need to do something else.
  • pdurbin
    did you reload citation.tsv? with curl?
  • Santiago Florez
    S
    jmmm no
  • I gonna try
  • Santiago Florez
    S
    Once I run the curl command, should I see changes to a new data set? or on all the datasets that I had created
  • pdurbin
    both
  • Ramin joined the room
  • Ramin
    T
    Hello, I am trying to add a new metadatablock (for local contexts labels). I could add my tsv with the api endpoint. However whenever I want to save a dataset with some fields of that metadataset, I get: "The metadata could not be updated. If you believe this is an error, please contact Root Support for assistance.". This is the tsv file that I started: https://github.com/RIDAGOP-IDS-Toolkit/tklabel/blob/main/localcontexts_dv_metadatablock.tsv
  • Ramin
    T
    In reply to
    T
    Ramin

  • Hello, I am trying to add a new metadatablock (for local contexts labels). I could add my tsv with the api endpoint. However whenever I want to save a dataset with some fields of that metadataset, I get: "The metadata could not be updated. If you believe this is an error, please contact Root Support for assistance.". This is the tsv file that I started: https://github.com/RIDAGOP-IDS-Toolkit/tklabel/blob/main/localcontexts_dv_metadatablock.tsv
  • Actually, I just notice, that with the latest version of the tsv, the metadata of a dataset DOES update, even tho it still shows the same error message
  • poikilotherm (CEST,UTC+2)
    Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • Ramin
    T
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • No! I didnt read that section :) thanks!
  • pdurbin
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • Don't mind me, I'm just testing a Matrix threads thing: https://github.com/IQSS/chat.dataverse.org/issues/16
  • pdurbin
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • One more post. Still testing. Please ignore.
  • Ramin
    T
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • after updating schema, it cannot reload. I am getting a 500, and in the response trace I see (down in the trace): "...Duplicate field definition for 'accessToSources' [[[accessToSources{type=text_en,properties=indexed,tokenized,stored,useDocValuesAsStored,uninvertible}]]] and [[[accessToSources{type=text_en,properties=indexed,tokenized,stored,useDocValuesAsStored,uninvertible}]]]\n" the field "accessToSou" is not from me. its the very first field in the file.
  • In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • luckily I have a backup of the schema :). I could reload that... I'm gonna try it again and look how the target-schema looks like after update-fields
  • pdurbin
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • Yeah, it sounds like your schema.xml file may have gotten trashed. 😅
  • Ramin
    T
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • indeed that field (and probably all of them) are twice in field and copyField
  • In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • well is it ok to just manully copy my new field into the schema file?
  • pdurbin
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • Oh! Just one field? Sure, I'd try just adding it to schema.xml
  • Ramin
    T
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • no not one... but an overseeable number, for now :)
  • In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • sorry "fields" :)
  • pdurbin
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • You should see your new fields at curl http://localhost:8080/api/admin/index/solr/schema
  • In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • You can copy and past from that output.
  • In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • That's what the script does. It tries to automate this.
  • Ramin
    T
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • yes, piping that file to the update-fields.sh trashed it. I am just copy over what I need.
  • pdurbin
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • This is documented at https://guides.dataverse.org/en/5.13/admin/metadatacustomization.html#updating-the-solr-schema
  • T
    Ramin
    : oh hey, would you be able to shoot me a description for your demo at https://dataverse.org/dataversetv ?
  • Ramin
    T
    In reply to
    pdurbin

  • T
    Ramin
    : oh hey, would you be able to shoot me a description for your demo at https://dataverse.org/dataversetv ?
  • sure! here you go: The RIDAGOP (Indigenous data sovereignty) toolkit (https://toolkit.ridagop.net/) allows developers to create generic data-management processes, connect them to data-repository systems. This demonstrates 2 processes; adding Local Contexts Labels to datasets and how to create a customizable data access application processes.
  • In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • ok. manually adding them worked. and saving the dataset goes through ! :) I might write a python script to the update in the future. not sure why the update-fields didnt work
  • * ok. manually adding them worked. and saving the dataset goes through ! :) I might write a python script to do the update in the future. not sure why the update-fields didnt work
  • pdurbin
    In reply to
    pdurbin

  • T
    Ramin
    : oh hey, would you be able to shoot me a description for your demo at https://dataverse.org/dataversetv ?
  • T
    Ramin
    : thanks! Are you slides online? If so, I can add a link.
  • In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • T
    Ramin
    : please feel free to open an issue about it: https://github.com/IQSS/dataverse/issues
  • pdurbin
    Have a great weekend, everyone!
  • p4addy joined the room
  • ralph joined the room
  • g-tenko-r joined the room
  • Adina Wagner changed their name to Adina Wagner 🔕📝
  • Ramin
    T
    In reply to
    pdurbin

  • T
    Ramin
    : oh hey, would you be able to shoot me a description for your demo at https://dataverse.org/dataversetv ?
  • Hi Phil, I just uploaded it here: https://drive.google.com/file/d/1lnYVYsTdPwIjn-QY8hXOeaZ1BiAvbWsT/view?usp=share_link
  • Ramin
    T
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • Hey, the metadatablock is almost done...
    However I still have some issues with displayFormat.
    this written into the cell only leads to showing the html as it is (with value, name properly inserted)
    <p>Label type: Seasonal<br/></p> LANG LABEL TEXT , and doesnt turn it into html
  • In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • <p>#NAME: #VALUE<br/></p>
  • Ramin
    T
    In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • another question... :) nested compounds dont work so well do they?
  • pdurbin
    In reply to
    pdurbin

  • T
    Ramin
    : oh hey, would you be able to shoot me a description for your demo at https://dataverse.org/dataversetv ?
  • Thanks! Now there's a link to your slides on DataverseTV
  • In reply to
    poikilotherm (CEST,UTC+2)

  • Did you adapt your Solr schema as described in the Metadata Customization Guide?
  • Nope. You mean https://github.com/IQSS/dataverse/issues/9200 right?
  • @pdurbin:matrix.org left the room
  • pdurbin joined the room
  • Ramin
    T
    In reply to
    pdurbin

  • T
    Ramin
    : oh hey, would you be able to shoot me a description for your demo at https://dataverse.org/dataversetv ?
  • nice!, thanks! I will present the metadatablock tmrw at the IDS symposium. I just need to loop it back to the folks of Local Contexts and then it would be ready soon. The repo I am currently using also contains a small sql script (https://github.com/RIDAGOP-IDS-Toolkit/tklabel/blob/main/metadata_clean.sql) that might be useful for as well. It helps removing rows in several databases related to metadatablocks. I used it to remove draft metadatablocks (I needed those, because the controlledVocabulary entries wouldn't go away, when I changed them.
  • @gremid:matrix.org left the room
  • Don Sizemore
    D
  • pdurbin
    Looks fine but I'm confused. I thought the version of node was too old or something.

You're viewing an archive of events from 2023-05-09. Use a Matrix client to start chatting in this room.

May 2023

  1. Sun
  2. Mon
  3. Tue
  4. Wed
  5. Thu
  6. Fri
  7. Sat
  8. 1
  9. 2
  10. 3
  11. 4
  12. 5
  13. 6
  14. 7
  15. 8
  16. 9
  17. 10
  18. 11
  19. 12
  20. 13
  21. 14
  22. 15
  23. 16
  24. 17
  25. 18
  26. 19
  27. 20
  28. 21
  29. 22
  30. 23
  31. 24
  32. 25
  33. 26
  34. 27
  35. 28
  36. 29
  37. 30
  38. 31

Developer options

Toggles

Backend timing

todo: window.tracingSpansForRequest

Room ID

!AmypvmJtUjBesRrnLM:matrix.org