WEBVTT

00:00:00.000 --> 00:00:05.602 align:middle line:90%


00:00:05.602 --> 00:00:07.310 align:middle line:84%
We have been looking
at, then, how we can

00:00:07.310 --> 00:00:08.930 align:middle line:90%
do motion capture of musicians.

00:00:08.930 --> 00:00:10.910 align:middle line:84%
But another group
of people that's

00:00:10.910 --> 00:00:12.440 align:middle line:84%
interesting to do
motion capture of

00:00:12.440 --> 00:00:16.550 align:middle line:84%
is perceivers, or audiences,
or people that experience

00:00:16.550 --> 00:00:17.893 align:middle line:90%
music in different ways.

00:00:17.893 --> 00:00:20.060 align:middle line:84%
And this is something that
you have experience with,

00:00:20.060 --> 00:00:23.600 align:middle line:84%
Victor, both in
capturing audiences,

00:00:23.600 --> 00:00:27.276 align:middle line:84%
like in the library
setting where we were,

00:00:27.276 --> 00:00:31.940 align:middle line:84%
or also even capture
audiences in the lab.

00:00:31.940 --> 00:00:33.620 align:middle line:84%
And what are some
of the challenges

00:00:33.620 --> 00:00:38.810 align:middle line:84%
when you're capturing
audiences with motion capture?

00:00:38.810 --> 00:00:41.850 align:middle line:84%
Well, when capturing
audiences in venues,

00:00:41.850 --> 00:00:43.490 align:middle line:84%
so there are many
other challenges

00:00:43.490 --> 00:00:46.200 align:middle line:84%
that have to do with the
practicalities of the place.

00:00:46.200 --> 00:00:48.230 align:middle line:84%
So to look at the
systems, to not

00:00:48.230 --> 00:00:51.960 align:middle line:84%
interfere with the experience of
the concert or the performance.

00:00:51.960 --> 00:00:53.450 align:middle line:84%
So audiences are
not used to being

00:00:53.450 --> 00:00:54.980 align:middle line:90%
part of experiments normally.

00:00:54.980 --> 00:00:57.450 align:middle line:84%
So they normally
adapt their behaviour.

00:00:57.450 --> 00:00:59.430 align:middle line:84%
So you have to be
aware of that as well.

00:00:59.430 --> 00:01:02.150 align:middle line:84%
So we have to limit how much
we affect the experience,

00:01:02.150 --> 00:01:04.099 align:middle line:84%
because we want them
as natural as possible.

00:01:04.099 --> 00:01:06.908 align:middle line:84%
So we call that ecology,
making the experiment

00:01:06.908 --> 00:01:08.450 align:middle line:84%
as ecological as
possible, so that we

00:01:08.450 --> 00:01:12.077 align:middle line:84%
get what we want, the pure
reactions from the audience.

00:01:12.077 --> 00:01:13.910 align:middle line:84%
So there are many
challenges, both practical

00:01:13.910 --> 00:01:16.535 align:middle line:84%
and also theoretical, on
how to do this properly.

00:01:16.535 --> 00:01:18.410 align:middle line:84%
And that's different
when we do it in the lab

00:01:18.410 --> 00:01:21.860 align:middle line:84%
and when we have just
perceivers in a lab.

00:01:21.860 --> 00:01:23.560 align:middle line:84%
They also know
it's an experiment.

00:01:23.560 --> 00:01:24.980 align:middle line:90%
So it's also challenging.

00:01:24.980 --> 00:01:26.480 align:middle line:84%
But the settings
are more controlled

00:01:26.480 --> 00:01:29.540 align:middle line:90%
than compared to a venue.

00:01:29.540 --> 00:01:33.290 align:middle line:84%
So the setup on the cameras and
things are kind of the same,

00:01:33.290 --> 00:01:34.960 align:middle line:84%
but it's more about
everything else.

00:01:34.960 --> 00:01:35.460 align:middle line:90%
Yeah.

00:01:35.460 --> 00:01:35.960 align:middle line:90%
I guess.

00:01:35.960 --> 00:01:38.870 align:middle line:84%
An environment and they
feel in lab, or like they

00:01:38.870 --> 00:01:40.320 align:middle line:90%
feel they are in an auditorium.

00:01:40.320 --> 00:01:43.700 align:middle line:84%
So when they're in the concert,
they are there to enjoy.

00:01:43.700 --> 00:01:46.790 align:middle line:84%
And so we don't want
to interfere with that

00:01:46.790 --> 00:01:49.960 align:middle line:84%
or to affect that experience,
when in a concert.

00:01:49.960 --> 00:01:51.710 align:middle line:84%
But you have also been
running experiments

00:01:51.710 --> 00:01:53.870 align:middle line:84%
with people where
it's more controlled.

00:01:53.870 --> 00:01:56.570 align:middle line:10%
And one particular type
of experiment paradigm

00:01:56.570 --> 00:01:59.480 align:middle line:10%
that you have been working
with is people standing still.

00:01:59.480 --> 00:02:04.550 align:middle line:10%
And what have you done then?

00:02:04.550 --> 00:02:06.680 align:middle line:84%
Yeah, we ask people
to stand as still as

00:02:06.680 --> 00:02:12.410 align:middle line:84%
possible while we will play
music or sounds in the lab.

00:02:12.410 --> 00:02:16.970 align:middle line:10%
And they stand in groups
together in the lab.

00:02:16.970 --> 00:02:18.692 align:middle line:84%
And it's always
counterintuitive.

00:02:18.692 --> 00:02:20.900 align:middle line:84%
So we're not used to standing
still for long periods,

00:02:20.900 --> 00:02:22.550 align:middle line:84%
or at least we try
to avoid those.

00:02:22.550 --> 00:02:25.050 align:middle line:84%
Like queuing is
uncomfortable, for example.

00:02:25.050 --> 00:02:27.620 align:middle line:84%
So we just want them to
stand there in silence and as

00:02:27.620 --> 00:02:28.980 align:middle line:90%
still as possible.

00:02:28.980 --> 00:02:31.220 align:middle line:84%
So it's not something
that we're used

00:02:31.220 --> 00:02:34.160 align:middle line:84%
to do, so it's challenging for
many of them, for many people.

00:02:34.160 --> 00:02:36.230 align:middle line:84%
And also the fact
that then there

00:02:36.230 --> 00:02:40.200 align:middle line:84%
is this music part coming
in and playing, so we have

00:02:40.200 --> 00:02:44.060 align:middle line:84%
had participants who are
unable to not move to music,

00:02:44.060 --> 00:02:47.460 align:middle line:84%
that they just want to dance,
if the music is too danceable.

00:02:47.460 --> 00:02:49.940 align:middle line:84%
But the challenges
remain and we want

00:02:49.940 --> 00:02:52.070 align:middle line:84%
them to forget that this
is, as possible, a lab,

00:02:52.070 --> 00:02:55.130 align:middle line:84%
that they just standing
as naturally as possible,

00:02:55.130 --> 00:02:59.480 align:middle line:84%
and that they don't
instinctively move to,

00:02:59.480 --> 00:03:00.980 align:middle line:84%
or they instinctively
move to music,

00:03:00.980 --> 00:03:02.450 align:middle line:84%
but not because
they want to dance,

00:03:02.450 --> 00:03:04.040 align:middle line:84%
but because it's
kind of-- you know,

00:03:04.040 --> 00:03:05.600 align:middle line:90%
it helps to move to music.

00:03:05.600 --> 00:03:08.360 align:middle line:84%
So this is kind of the
challenges that we want to face

00:03:08.360 --> 00:03:10.850 align:middle line:84%
and we are trying to
deal with now here

00:03:10.850 --> 00:03:14.540 align:middle line:84%
with these statistical data
set and the experiments.

00:03:14.540 --> 00:03:17.840 align:middle line:84%
We want participants
to experience music,

00:03:17.840 --> 00:03:20.330 align:middle line:84%
and we want to know what it
does naturally to the bodies.

00:03:20.330 --> 00:03:22.370 align:middle line:84%
So for that we need them
to forget that they are

00:03:22.370 --> 00:03:24.558 align:middle line:90%
being measured, for example.

00:03:24.558 --> 00:03:26.850 align:middle line:84%
Is it really possible to
capture people standing still?

00:03:26.850 --> 00:03:28.880 align:middle line:84%
I mean these must be
very small movements.

00:03:28.880 --> 00:03:30.410 align:middle line:90%
Yeah, they're minuscule.

00:03:30.410 --> 00:03:33.320 align:middle line:84%
But we never are
completely still.

00:03:33.320 --> 00:03:37.010 align:middle line:84%
We breathe, our heartbeats, we
have to accommodate a posture

00:03:37.010 --> 00:03:38.940 align:middle line:90%
if we stand for longer periods.

00:03:38.940 --> 00:03:41.067 align:middle line:84%
So there's always these
movements that occur.

00:03:41.067 --> 00:03:42.650 align:middle line:84%
So on top of that,
there is a movement

00:03:42.650 --> 00:03:45.050 align:middle line:84%
that we have measured that
occurs because of the music,

00:03:45.050 --> 00:03:47.032 align:middle line:84%
or apparently
because of the music.

00:03:47.032 --> 00:03:48.740 align:middle line:84%
So on top of these
natural movements that

00:03:48.740 --> 00:03:50.157 align:middle line:84%
happen when we are
standing still,

00:03:50.157 --> 00:03:51.883 align:middle line:84%
there is something
else that's happening

00:03:51.883 --> 00:03:53.300 align:middle line:84%
when the music is
being presented,

00:03:53.300 --> 00:03:55.520 align:middle line:84%
and that's what we're
trying to understand.

00:03:55.520 --> 00:03:58.550 align:middle line:84%
And you've been measuring
people's head motion,

00:03:58.550 --> 00:04:00.740 align:middle line:84%
you've been putting
a marker on the head

00:04:00.740 --> 00:04:03.047 align:middle line:84%
and then you see people
swaying and things.

00:04:03.047 --> 00:04:04.880 align:middle line:84%
But then again that's
on a very small scale.

00:04:04.880 --> 00:04:05.380 align:middle line:90%
Yeah.

00:04:05.380 --> 00:04:07.037 align:middle line:84%
Yeah, I mean, it's
because the marker

00:04:07.037 --> 00:04:08.120 align:middle line:90%
is on the top of the head.

00:04:08.120 --> 00:04:09.540 align:middle line:90%
So we see mostly head sway.

00:04:09.540 --> 00:04:12.618 align:middle line:84%
But it's still minuscule,
unless they really

00:04:12.618 --> 00:04:13.910 align:middle line:90%
change the posture of the head.

00:04:13.910 --> 00:04:15.500 align:middle line:84%
But they know they
are being recorded.

00:04:15.500 --> 00:04:16.610 align:middle line:84%
They know they have
to stand still.

00:04:16.610 --> 00:04:17.930 align:middle line:90%
So they normally don't do it.

00:04:17.930 --> 00:04:20.390 align:middle line:90%
They don't do gross motions.

00:04:20.390 --> 00:04:22.730 align:middle line:84%
So it's normally
very small, and we

00:04:22.730 --> 00:04:26.480 align:middle line:84%
have to really dig in to find
what, when, where was the music

00:04:26.480 --> 00:04:28.370 align:middle line:90%
influencing this movement.

00:04:28.370 --> 00:04:29.950 align:middle line:84%
And then we have
collected this also,

00:04:29.950 --> 00:04:31.850 align:middle line:84%
in this Oslo standstill
database, right?

00:04:31.850 --> 00:04:32.090 align:middle line:90%
Yeah.

00:04:32.090 --> 00:04:33.550 align:middle line:84%
It's actually hundreds
of recordings.

00:04:33.550 --> 00:04:35.070 align:middle line:84%
Yeah, we have done it
for several years now.

00:04:35.070 --> 00:04:36.737 align:middle line:84%
And every year we
have 100 participants.

00:04:36.737 --> 00:04:39.410 align:middle line:84%
So we have like
600 people's data

00:04:39.410 --> 00:04:42.590 align:middle line:84%
on how they moved
their body, when

00:04:42.590 --> 00:04:44.130 align:middle line:90%
they are trying not to move.

00:04:44.130 --> 00:04:46.100 align:middle line:84%
So it's quite
interesting and it's also

00:04:46.100 --> 00:04:48.020 align:middle line:84%
interesting to see what people
will do with this database

00:04:48.020 --> 00:04:50.353 align:middle line:84%
in the future, because it
will be available for everyone

00:04:50.353 --> 00:04:53.570 align:middle line:90%
to try and play with this data.

00:04:53.570 --> 00:04:56.840 align:middle line:84%
OK, so, as you hear, there
are many different types

00:04:56.840 --> 00:04:58.400 align:middle line:84%
of things to think
about when you

00:04:58.400 --> 00:05:02.750 align:middle line:84%
are doing motion capture
of audiences or perceivers,

00:05:02.750 --> 00:05:04.400 align:middle line:84%
whether it's people
standing still,

00:05:04.400 --> 00:05:07.910 align:middle line:84%
or people sitting in an
audience or moving around.

00:05:07.910 --> 00:05:11.360 align:middle line:84%
So that's also related to
whether you are working

00:05:11.360 --> 00:05:12.700 align:middle line:90%
in the lab or outside the lab.

00:05:12.700 --> 00:05:15.540 align:middle line:84%
So it's not really anything that
you can say is right or wrong.

00:05:15.540 --> 00:05:17.832 align:middle line:84%
It's just different in a way,
and many different things

00:05:17.832 --> 00:05:19.660 align:middle line:90%
to think about.

00:05:19.660 --> 00:05:27.062 align:middle line:90%