Knowledgefeed vol. 29: revisited
Jelena’s and Marcin’s talks are now on our youtube channel.
Slides are available here.
You can find slides for this talk here.…
Read moreBlog
VDSG blog
Spark descriptive name for cached dataframes
Concise names for cached tables.
By Georg Heiler
Have you ever wondered where the cryptic names of cached dataframes and RDD in Spark’s web UI belong to? Usually no specific name is set. When you apply a df.cache spark will auto generate the name as a snippet from the query plan.…
Ultimate Open Vector Geoprocessing on Spark
By Georg Heiler
More and more people start to work with large quantities of geospatial data and think about using spark and one of its geospatial additions like geomesa, geospark or geotrellis. And soon they come to realize that one of the tools does not provide a function which would be commonly required.…
Read moreScalable cohort sampler
Use Dask to paralellize python
By Georg Heiler
I have a some binary cohorts and need to sample for each cohort where the target label 1 is matching a observation from a dataframe where the target is 0.
sample data
First, I will generate some sample data.…
Read more
VDSG Knowledgefeed vol. 27 revisited
Simon Stiebellehner’s & Daniel Ressi’s talk is now on our youtube channel.
Download Simon’s and Daniel’s presentation slides here.…
Read moreDS Salon Vol 2: Impact on society with Data with Dr. Claire Melamed – revisited
On June 21 the Data4Good program lead by VDSG was formally launched with the second edition of our new format Data Science Salon. The agenda and additional details can be found on our meetup page of the event. The videos are now on our youtube channel.…
Read moreVDSG Knowledgefeed vol. 24 revisited
Krista Westphal’s and Christian Göbel’s talks are now on our youtube channel.
Download Krista’s presentation here, an Christian’s presentation here.…
Read moreData Science Salon Vol. I: GDPR and its impact on Data Science – revisited
On 23rd of April we introduced a new event format to our community: the Data Science Salon.
Data Science and its applications have the potential to tremendously impact our society in ways we have rarely seen in the past. Besides a lot of other things, it will lead to an automation of many aspects of our lives, aiming to improve them.…
Read more