|
List Info
Thread: Re: Testing your own sites
|
|
| Re: Testing your own sites |
  United States |
2007-02-05 13:27:11 |
I'll strongly agree that close user contact gives the best
results
for a specific project, whether watching them or working
with them
informally in their environment.
In those cases, a full usability lab isn't very good.
However,
advancing IA as a profession does require use of a full
usability
lab. (Warning, I'm an academic, so I'm rather biased on
what follows.)
The purpose of testing a specific design, like the web site
you are
building for a client, is to maximize that design. It's
very hard to
try out new and different methods since they can result in
design
failure. Or worse, they work on project A and fail
miserably on
project B, when most things between the 2 projects seem to
be the
same. So, of course, your boss says never to use that
approach/design again.
Enter the academic use of the usability lab, doing formal
studies
with statistical significance on the various design features
and
methods to build the fundamental ideas for moving design
forward. This can help determine if it was project A or B
that was
the fluke. The focus is not getting a single project out
the door;
it's figuring out what will work to improve out best
practices (I
know, dangerous phrase) and test out new ideas. We hear
that people
don't like stories of "what worked for me" as
evidence as best
practice since there are always so many other factors.
Those other
factors are always going to be there and will always be a
real pain,
but at least with formal testing of the fundamental concepts
you use
for creating the design, you can feel more confident that
the big
issues will arise from those other factors and not from the
design itself.
The overall problem is highly complex and much more than the
sum of
its parts. But let's make sure we do have a firm grasp of
each of
those parts. Otherwise we'll never have a clue how to
project the
ripple effects across the entire system/culture (which will
always be
iffy anyway in a complex system).
Mike
>My general findings is what is good for client
communication and
>what is good to deliver the best possible project are,
unsuprsingly,
>not the same thing. For example a usability lab is
great for
>clients, they can sit behind the glass, see real users
say real
>things and feel like they're in a hollywood movie. The
raw reality
>is that for fact finding a usability lab offers no
advantage over a
>good researcher visiting the users in their native
environment (and
>I know many will disagree with this but the reason for
this lies in
>what I'm saying here).
>Users will often tell you why without needing to try and
find it out
>indirectly, this is uncovered if you understand where
the use of a
>interactive system fits within a larger context. User
research, in
>my view, is really about the why - why do users do
things. This is
>followed by what they need to do the tasks and finaly
how they carry
>out that task.
------------------------------------------
Dr. Michael J. Albers
Professional Writing Program
Department of English
University of Memphis
Memphis TN 38152
malbers memphis.edu
------------
IA Summit 2007: Enriching IA
Rich Information, Rich Interaction, Rich Relationships
March 22-26, 2007, Las Vegas, NV
www.iasummit.org
-----
When replying, please *trim your post* as much as possible.
*Plain text, please; NO Attachments
Searchable Archive at http://www.in
fo-arch.org/lists/sigia-l/
________________________________________
Sigia-l mailing list -- post to: Sigia-l asis.org
Changes to subscription: http://
mail.asis.org/mailman/listinfo/sigia-l
|
|
| Re: Testing your own sites |
  United States |
2007-02-05 14:44:12 |
Michael Albers:
> advancing IA as a profession does require use of a full
usability lab.
It does????
> The focus is not getting a single project out the door;
it's figuring out what
> will work to improve out best practices (I know,
dangerous phrase) and test
> out new ideas.
Yep, you *are* an academic.
> We hear that people don't like stories of "what
worked for me" as evidence as
> best practice since there are always so many other
factors.
Well, there *are* always so many other factors.
> Those other factors are always going to be there and
will always be a real
> pain, but at least with formal testing of the
fundamental concepts you use for
> creating the design, you can feel more confident that
the big issues will
> arise from those other factors and not from the design
itself.
Singling out factors to test is a difficult task in and of
itself, but I'm
not sure what relevance a "full usability lab" has
in that matter?
> The overall problem is highly complex and much more
than the sum of
> its parts.
Quite. But I'm still not sure what that has to do with the
*requirement* of
a "full usability lab"?
----
Ziya
"If I had asked my customers what they wanted,
they would have asked for a faster horse." -- Henry
Ford
------------
IA Summit 2007: Enriching IA
Rich Information, Rich Interaction, Rich Relationships
March 22-26, 2007, Las Vegas, NV
www.iasummit.org
-----
When replying, please *trim your post* as much as possible.
*Plain text, please; NO Attachments
Searchable Archive at http://www.in
fo-arch.org/lists/sigia-l/
________________________________________
Sigia-l mailing list -- post to: Sigia-l asis.org
Changes to subscription: http://
mail.asis.org/mailman/listinfo/sigia-l
|
|
| Re: Testing your own sites |

|
2007-02-05 15:23:21 |
On 2/6/07, Michael Albers <malbers memphis.edu> wrote:
> Enter the academic use of the usability lab, doing
formal studies
> with statistical significance on the various design
features and
> methods to build the fundamental ideas for moving
design
> forward. This can help determine if it was project A
or B that was
> the fluke. The focus is not getting a single project
out the door;
> it's figuring out what will work to improve out best
practices (I
> know, dangerous phrase) and test out new ideas. We
hear that people
> don't like stories of "what worked for me" as
evidence as best
> practice since there are always so many other factors.
Those other
> factors are always going to be there and will always be
a real pain,
> but at least with formal testing of the fundamental
concepts you use
> for creating the design, you can feel more confident
that the big
> issues will arise from those other factors and not from
the design itself.
Mike,
we do "what worked for me" because it is the path
of least resistance
when we are too busy, too tired, too weary of fighting the
good fight
- sometimes we justify it by invoking the Holy Grail of best
practice
- but here, amongst ourselves, just we practitioners alone -
please
let us not in any way pretend that this is a good thing I am not
saying that you are advocating a hollow best practice gloss
on a
rotten solution, but there are those about that do.
That said, "what worked for me" can be a good
thing if it does
coincide with those other factors (for example, "what
is the best
solution for the end users", "what is the best
solution within the
client budget", and "what is the best solution for
the client
organisation", which are not always the same thing when
working within
Government). It would be interesting to study how often
these do
coincide - how often an IA/Designer/etc delivers the
minimal
brainpower solution that is serendipitously also the
optimum.
Best regards, Andrew
------------
IA Summit 2007: Enriching IA
Rich Information, Rich Interaction, Rich Relationships
March 22-26, 2007, Las Vegas, NV
www.iasummit.org
-----
When replying, please *trim your post* as much as possible.
*Plain text, please; NO Attachments
Searchable Archive at http://www.in
fo-arch.org/lists/sigia-l/
________________________________________
Sigia-l mailing list -- post to: Sigia-l asis.org
Changes to subscription: http://
mail.asis.org/mailman/listinfo/sigia-l
|
|
[1-3]
|
|