Our next Folk open house will be on Thursday, May 28, at our new studio in Williamsburg, Brooklyn. RSVP here:

RSVP for the Folk open house on May 28

We'll also be giving a talk at School of Visual Arts in Manhattan on this coming Friday, May 8:

Talk at SVA on Friday, May 8

Last month, we started moving out of Hex House and into a new studio space in Williamsburg. We continued that process this month and finalized a lot of the layout (although we don't necessarily have final mounting situation and tables/storage yet).

We moved from last month's tiny setup along the wall to more of an L-shaped dedicated area, realizing that even a long 2-projector linear setup along the wall felt awkward. Was hard to have multiple people working together, limited edge area for people to sit, etc.

Setting up the new L area, which has one projector+camera over each side of the L:

Was trying the Logitech Brio 4K on one side and NexiGo on the other side at first. Horrible issues with USB3; ultimately gave up on the Brio 4K for now.

(I think it's the SAM2 demo that's running/rerunning all the time and really pushing the Nvidia drivers.)

In the new studio, we want to set up Folk systems over some of the tables that aren't in our dedicated space, so we can sprawl out more during events and if multiple of us are trying things (and also hopefully have passersby playing with Folk eventually).

The first new area we set up is this communal table in the middle of the space.

We also wanted to look into the modern portable 4K projector landscape now that AAXA is defunct – what should we be recommending to people if they want a bright, high-resolution, easy-ish-to-mount system?

Bought a JMGO N1 Ultra 4K projector on eBay for a great price ($700-800); sadly, that exact listing doesn't seem to be available anymore, but various 4K JMGO projectors are still available in various places for good prices. You can see it weighs about 9 pounds:

It's not as light as the AAXA 4K1 (4ish pounds), but it's similar price and much, much brighter.

C-stand setup

We moved the CNC machine from our CNC project last year, but it's not fully set up yet.

Packing up from Hex House and seeing the dust underneath:

Moving:

TODO

• TODO
• Andrés brought back tag masking so projections don't interfere with tag detection
  • 
• Andrés fixed support for left-margined, right-margined, footnoted ways to draw text on margins of a program
• Andrés fixed transparency in compositing
• Omar improved the new logging system:
  • Put all logs for a given folk PID in /var/tmp/folk-PID subfolder
  • Report web system error at console since without working web page, hard to debug failures
  • Fix various cases where we weren't capturing output into stdout or stderr (library output, subprocesses) by turning off FORTIFY_SOURCE; made OTHER.stdout and OTHER.stderr as catch-alls when we can't do proper redirection (as opposed to going to /dev/null)

Omar started working on new Bluetooth keyboard support where we don't need a custom udev device path in by-path

Omar: The new Folk setup at the studio has this L layout where we want at least 2 projectors and 2 cameras connected to the same PC, so I've been working on refactoring Folk so that one Folk system can calibrate and drive all that hardware simultaneously. (until now, every Folk system has had exactly 1 active projector and 1 active camera)

While at it, I also wanted to improve support for these types of ELP stereo cameras, which we have been using in the gadget (but are not really using the stereo yet). Trying to use it in the studio Folk setup as well.

Given this stereo camera, how can we add crop support to the UI and ultimately calibrate and use both 'eyes' to do better pose estimation?

I added a camera crop UI to the Folk /setup interface. You create a “virtual cropped camera”, which makes a green rectangle that lets you select an area to crop a camera to. The virtual camera then exists with that cropped area, and you can calibrate, track tags, etc on that camera:

(We use this to pick just the left eye for now out of a stereo side-by-side ELP image, but eventually want to use this to create virtual cameras out of both eyes to co-calibrate.)

Added a setting on /camera that lets you set the exposure (and auto-exposure mode) live right there. Also now iframe /camera on the calibration page, so we have just that one uniform UI for camera config (including any future settings we might want to add), rather than /calibrate having its own one-off exposure slider.

Omar: This is still on a branch, but hasn't been that successful an experiment. Will try a few more things. The goal here is to get calibrate to 1. work better on various cameras we have (ELP stereo camera has a lot of distortion) and 2. be easier to fixup later if you bump the camera.

(Usually, in my experience, calibration quality rides on the specific camera you're using. Projectors are usually easy-ish to calibrate [except ultra-short-throw], while cameras have more distortion and variability. My home system pretty much always calibrates perfectly – the Brio 4K was mediocre, and the NexiGo has been good. The ELP is also mediocre.)

People regularly have this silent failure when calibrating, where there's not enough variance in their poses (they kept the board flat on the table the whole time), and the optimization and/or refinement fails to converge:

Made preview on /calibrate a side panel: reduces the length of the page / amount of stuff on the critical path that you read, makes it easier to see what's going on as you calibrate and refine and adjust exposure in real-time.

Also added green outlines for tag detections (again, so you can quickly spot if your calibration is failing because not enough tags are getting picked up).

We threw a studio-warming party for the new space, where a lot of people played with the Folk system, especially animation:

Also, we had a great open house at the end of the month, on April 27:

• We'll be giving a talk at SVA on Friday, May 8.
• Our next RSVP for the Folk open house on Thursday, May 28, at our new studio in Williamsburg.
• Omar: I'll be trying to improve calibration of our ELP camera & working on the Folk gadget.

• Make your own Are.na frame
• The Design of Browsing and Berrypicking Techniques for the Online Search Interface (Marcia J. Bates, 1989)
• Cybernetics Image Library
• Apps and programming: two accidental tyrannies
• Hyperscript
• Scrolls Scrolling
• The Hardest Working Font in Manhattan

• https://d29g4g2dyqv443.cloudfront.net/sites/default/files/akamai/gameworks%2Fblog%2Fmunich%2Fmschott_vulkan_multi_threading.pdf
• https://x.com/AaronKoelker/status/1812987942987513863
• https://worc.dev/#
• https://blog.jtfmumm.com/2016/03/06/safely-sharing-data-pony-reference-capabilities/
• https://svnbook.red-bean.com/en/1.7/svn.foreword.html
• https://debamax.com/blog/2019/01/03/debugging-with-netconsole/