dataverse

    Jump to previous activity in the room
  • Vincent Arel-Bundock joined the room
  • Don Sizemore
    D
    O
    poikilotherm (CEST,UTC+2)    : on directory config source. is the default domain1/secrets/ sufficient? I ask because docker-compose-dev.yml uses docker-dev-volumes/app/secrets/
  • poikilotherm (CEST,UTC+2)
    D
    Don Sizemore    : it may be sufficient if you like it 😅
  • I'm deliberately changing this in the container to /secrets so it becomes easier to use in that context
  • (Usually secrets do become mounted as files, mapped from some place else, so making the path shorter is what folks love to see)
  • pdurbin
    Our annual IT summit is back for the first time since the pandemic but it conflicts with #dataverse2023. Bummer. 😢 https://itsummit.harvard.edu
  • "Self-directed option: choose your own topic" on the hackathon page. We could have had a hackathon for Dataverse!
  • poikilotherm (CEST,UTC+2)
    We still can. I'll be there on Saturday already. All Sunday for happy hacking!
  • pdurbin
    And Thursday! Who's with me?!
  • poikilotherm (CEST,UTC+2)
    I have a suspicion that
    J
    Johannes Darms     might be there on the same days. He might be flying in from DUS just as me 😜
  • Don Sizemore
    D
    O
    poikilotherm (CEST,UTC+2)    : I'm wrestling with using secrets/ to include non-sensitive configuration bits, but happy to do so to keep it all in one directory.
  • poikilotherm (CEST,UTC+2)
    I'm not sure what your problem may be... 🤔
  • pdurbin
    "Hi Philip- I’ll make a note to connect for next year’s planning, maybe we could even look into a challenge sponsored by Dataverse! -Amy"
  • pdurbin
    Have a good weekend and Happy Mother's Day!

  • omooaiya joined the room
  • omooaiya changed their name to Omo Oaiya
  • @omooaiya:matrix.ren.ng left the room

  • Johannes Darms
    J
    In reply to
    poikilotherm (CEST,UTC+2)
  • I have a suspicion that
    J
    Johannes Darms     might be there on the same days. He might be flying in from DUS just as me 😜
    • My flight is on Monday, but if I'm not mistaken Vera is already there.
  • In reply to
    pdurbin
  • And Thursday! Who's with me?!
    • Im available for a meeting and discussion. We could use the time to discuss Auth and SPA roadmaps...
  • bergs joined the room
  • pdurbin
    In reply to
    pdurbin
  • And Thursday! Who's with me?!
    • Hmm. Maybe.
    J
    Jan Range     and I might walk around until our feet hurt (again). 😄
  • pdurbin
    J
    Johannes Darms    : thanks for the new PR! There's some discussion about Keycloak and docker compose at https://dataverse.zulipchat.com/#narrow/stream/375812-containers/topic/Keycloak

  • beep
    Hi! Is there a way to automatically generate an api token for every registered user? I would like to avoid them having to go to the API Token tab to generate it manually.
  • bergs
    B
    Hi, I'm newbie exploring dataverse to be used as a RDM platform vs invenio or different alternatives. I've installled 'archive in a box' dataverse with docker https://github.com/IQSS/dataverse-docker

    Logged as dataverseAdmin, I cannot see 'dashboard menu item'. I am supposed to be a superuser, but I don't know how to check it, how to give superuser role to dataverseAdmin.

    Any help would be greatly appreciated.
  • beep
    In reply to
    beep
  • Hi! Is there a way to automatically generate an api token for every registered user? I would like to avoid them having to go to the API Token tab to generate it manually.
    • I found getValidApiTokenForUser(), that will do it!
  • pdurbin
    B
    bergs    : hi! This might help: https://github.com/IQSS/dataverse-docker/issues/78#issuecomment-1338018226
  • S
    Vyacheslav Tikhonov    : should we re-open that issue? It seems to keep happening.
  • B
    beep    : oh good, I'm glad that will work for you.
  • community call in about 3 hours: https://groups.google.com/g/dataverse-community/c/OAkypfJiJBk/m/RU-VUVYxAgAJ
  • bergs
    B
    In reply to
    pdurbin
  • B
    bergs    : hi! This might help: https://github.com/IQSS/dataverse-docker/issues/78#issuecomment-1338018226
    • yess! it worked
  • In reply to
    pdurbin
  • B
    bergs    : hi! This might help: https://github.com/IQSS/dataverse-docker/issues/78#issuecomment-1338018226
    • thanks a lot
  • pdurbin
    In reply to
    pdurbin
  • B
    bergs    : hi! This might help: https://github.com/IQSS/dataverse-docker/issues/78#issuecomment-1338018226
    • Sure.
    B
    bergs     can you please leave a comment on that issue to say that you had this issue as well (and which version, please).
  • prsridha
    P
    Hello, I'm trying to upload a large dataset and it's taking a lot of time. I have a script that will upload my dataset in chunks via multiple parallel processes. Can I use this script to upload to Dataverse? All processes will use the same API key.

  • pdurbin
    P
    prsridha    : is your installation of Dataverse using S3 on the backend?
  • prsridha
    P

    This message is being deleted…

  • In reply to
    pdurbin
  • P
    prsridha    : is your installation of Dataverse using S3 on the backend?
    • No it's on our private NFS
  • g.sarigiannis
    G
    Hello, I just tried to upload my first dataset in a fresh dataverse installation, it's a small excel file and the upload process is stuck, won't complete. Any tips?
  • pdurbin
    P
    prsridha    : ok. Have you tried your script already? Does it work with Dataverse?
  • G
    g.sarigiannis    : I would check for a dataset lock: https://guides.dataverse.org/en/5.13/admin/troubleshooting.html#a-dataset-is-locked-and-cannot-be-edited-or-published
  • Don Sizemore
    D
    @prsridha how large is this dataset? depending on filetype (ingest) Dataverse may make 2-3 copies of each file during upload.
  • g.sarigiannis
    G
    P
    pdurbin    : thanks, I just tried uploading different file types and apparently the problem occurs when trying to upload .xlsx files. Anything that could cause this?
  • pdurbin
    G
    g.sarigiannis    : anything in server.log?
  • g.sarigiannis
    G
    This warning appears, can't say whether it's relevant: JSF1095: The response was already committed by the time we tried to set the outgoing cookie for the flash. Any values stored to the flash will not be available on the next request.
  • pdurbin
    yeah, we see that a lot and it's unrelated, I'd say, sorry for the noise
  • You could try uploading your Excel file to https://demo.dataverse.org
  • just to see if it works
  • g.sarigiannis
    G
    P
    pdurbin    : thanks, it seems the problem was down to that specific .xlsx file. Are there any limitations to the way files are supposed to be structured?
  • Vincent Kadar joined the room
  • pdurbin
    G
    g.sarigiannis    : we've been meaning to document this better for a while. You might find some tips at https://github.com/IQSS/dataverse/issues/7452
  • g.sarigiannis
    G
    P
    pdurbin    : Thank you for this link. I just realized that the problem is not related to the file type, but to the file size(?). Any file with size over 1MB gets stuck and doesn't upload. I've set the file size limit to 2 GB. Any thoughts?
  • Vincent Kadar
    H

    This message is being deleted…

  • @hjesfe:matrix.org was banned from the room by pdurbin

  • @g-tenko-r:matrix.freyachat.eu left the room
  • pdurbin
    G
    g.sarigiannis    : sorry, I just noticed this. 1 MB is obviously super small. Something must be misconfigured but I'm not sure what. How did you install Dataverse? By following the guides? Or with dataverse-ansible? Or dataverse-docker?
  • juanlopezur
    J
    Hello! If a researcher has some Files in One Drive can I harvest those Files in a dataset?
  • pdurbin
    J
    juanlopezur    : Dataverse integrates with Dropbox and Globus but not OneDrive. You are welcome to create an issue for this: https://github.com/IQSS/dataverse/issues
  • juanlopezur
    J
    Thank you! I'll create the issue

  • g.sarigiannis
    G
    In reply to
    pdurbin
  • G
    g.sarigiannis    : sorry, I just noticed this. 1 MB is obviously super small. Something must be misconfigured but I'm not sure what. How did you install Dataverse? By following the guides? Or with dataverse-ansible? Or dataverse-docker?
    • It was a misconfiguration of nginx, all good! Thank you for your help!
  • pdurbin
    phew! 😅 thanks for letting us know!
  • pdurbin
    Have a good weekend everyone!

  • @ralph:fx45.in left the room

  • haker404 joined the room
  • reis.quarteu joined the room
  • reis.quarteu
    R
    Good morning. I work in a portuguese institution that makes research in agriculture topic. I am installing Dataverse in that institution but I have an important question. How can I use an agriculture controlled vocabulary in keywords, is it possible?
  • pdurbin

    R
    reis.quarteu: do you mean a vocabulary like AGROVOC? It's mentioned here: https://github.com/gdcc/dataverse-external-vocab-support/blob/main/docs/readme.md

    Also, will you be in Braga for #dataverse2023?

  • reis.quarteu
    R
    Yes, I will try to be present in #dataverse2023, at least for 1 day.
  • pdurbin
    Nice! I'll be there.
  • reis.quarteu
    R
    👍️
  • pdurbin
    R
    reis.quarteu    : so is AGROVOC what you want? Or some other vocabulary?
  • reis.quarteu
    R
    Yes I think AGROVOC is what I need, but I have a new doubt. 'skosterm' is not a datasetField name of a field defined in a metadata block file, is it? Can the 'skosterm' field-name be replaced by 'keyword' or the 'keyword' field must be be hidden and 'skosterm' must be used?
  • pdurbin
    It's complicated.
    R
    reis.quarteu     can you please create a new issue in https://github.com/IQSS/dataverse/issues ? Something like "AGROVOC for keyword" would be a good title. I'd like to see what
    Q
    qqmyers     thinks.
  • reis.quarteu
    R
    Yes, I will do it.
  • pdurbin
    I see it: https://github.com/IQSS/dataverse/issues/9604 . Thanks!
  • reis.quarteu
    R
    Meanwhile, is it possible to have a simpler solution (a controlled vocabulary with agriculture terms defined by our organization) , something like an internal controlled vocabulary?
  • pdurbin
    For "keyword"?
  • reis.quarteu
    R
    Yes
  • pdurbin
    (in the citation block?)
  • reis.quarteu
    R
    yes
  • pdurbin
    That's what we'll want to ask
    Q
    qqmyers     about in the issue you opened. I'm not sure.
  • An alternative would be to create your own custom metadata block.
  • (I'm asking
    Q
    qqmyers     in Slack, by the way.)
  • reis.quarteu
    R
    In reply to
    pdurbin
  • An alternative would be to create your own custom metadata block.
    • Something similar to the Controlled Vocabulary used for 'Subject' datasetfield in 'citation' MetadataBlock.
  • pdurbin
    Yes, exactly. With your own custom metadata block you could store the controlled vocabulary values in the database.
  • We do this all the time for Harvard Dataverse: https://github.com/IQSS/dataverse.harvard.edu/blob/3fc9bfe9a171b2f7546ad44b1114f5c3920907d1/metadatablocks/custom3d.tsv#L16
  • pdurbin
    You could also attach an external controlled vocabulary (like AGROVOC) to your custom metadata block.
  • Anyway, various options. I'm just not sure about using an external vocab with the existing "Keyword" field in the citation block.
  • Don Sizemore
    D
    @pdurbin cowbox fix Q?
  • pdurbin
    yee haw, whatchu got,
    D
    Don Sizemore     ?
  • Don Sizemore
    D
    @pdurbin I'm kludging up the ec2-create script for perpetuity, and can't remember why it installs nano
  • @pdurbin my kludge is to enable epel-testing ongoing to avoid Ansible package dependency gaps during release churn
  • pdurbin
    I'm a vi guy. You can kill nano
  • Don Sizemore
    D
    @pdurbin good, 'cause I already did. see #dv-tech for a potential and easy fix for the NodeJS package installation failures, since we're back on that again.
  • pdurbin
    L
    luddaniel     (or anyone): what does "Mo" mean at https://github.com/IQSS/dataverse/issues/9606 , please? My guess is mégaoctets.
    • Jump to the next activity in the room

You're viewing an archive of events from 2023-05-22. Use a Matrix client to start chatting in this room.

May 2023

  1. Sun
  2. Mon
  3. Tue
  4. Wed
  5. Thu
  6. Fri
  7. Sat
  8. 1
  9. 2
  10. 3
  11. 4
  12. 5
  13. 6
  14. 7
  15. 8
  16. 9
  17. 10
  18. 11
  19. 12
  20. 13
  21. 14
  22. 15
  23. 16
  24. 17
  25. 18
  26. 19
  27. 20
  28. 21
  29. 22
  30. 23
  31. 24
  32. 25
  33. 26
  34. 27
  35. 28
  36. 29
  37. 30
  38. 31

Developer options

Toggles

Backend timing

todo: window.tracingSpansForRequest

Room ID

!AmypvmJtUjBesRrnLM:matrix.org