List Info

Thread: Re: Testing your own sites




Re: Testing your own sites
country flaguser name
United States
2007-02-05 13:27:11
I'll strongly agree that close user contact gives the best
results 
for a specific project, whether watching them or working
with them 
informally in their environment.

In those cases, a full usability lab isn't very good. 
However, 
advancing IA as a profession does require use of a full
usability 
lab.  (Warning, I'm an academic, so I'm rather biased on
what follows.)

The purpose of testing a specific design, like the web site
you are 
building for a client, is to maximize that design.  It's
very hard to 
try out new and different methods since they can result in
design 
failure.  Or worse, they work on project A and fail
miserably on 
project B, when most things between the 2 projects seem to
be the 
same.  So, of course, your boss says never to use that
approach/design again.

Enter the academic use of the usability lab, doing formal
studies 
with statistical significance on the various design features
and 
methods to build the fundamental ideas for moving design 
forward.  This can help determine if it was project A or B
that was 
the fluke.  The focus is not getting a single project out
the door; 
it's figuring out what will work to improve out best
practices (I 
know, dangerous phrase) and test out new ideas.  We hear
that people 
don't like stories of "what worked for me" as
evidence as best 
practice since there are always so many other factors. 
Those other 
factors are always going to be there and will always be a
real pain, 
but at least with formal testing of the fundamental concepts
you use 
for creating the design, you can feel more confident that
the big 
issues will arise from those other factors and not from the
design itself.

The overall problem is highly complex and much more than the
sum of 
its parts.  But let's make sure we do have a firm grasp of
each of 
those parts.  Otherwise we'll never have a clue how to
project the 
ripple effects across the entire system/culture (which will
always be 
iffy anyway in a complex system).

Mike

>My general findings is what is good for client
communication and 
>what is good to deliver the best possible project are,
unsuprsingly, 
>not the same thing.  For example a usability lab is
great for 
>clients, they can sit behind the glass, see real users
say real 
>things and feel like they're in a hollywood movie.  The
raw reality 
>is that for fact finding a usability lab offers no
advantage over a 
>good researcher visiting the users in their native
environment (and 
>I know many will disagree with this but the reason for
this lies in 
>what I'm saying here).

>Users will often tell you why without needing to try and
find it out 
>indirectly, this is uncovered if you understand where
the use of a 
>interactive system fits within a larger context.  User
research, in 
>my view, is really about the why - why do users do
things.  This is 
>followed by what they need to do the tasks and finaly
how they carry 
>out that task.


------------------------------------------
Dr. Michael J. Albers
Professional Writing Program
Department of English
University of Memphis
Memphis  TN  38152
malbersmemphis.edu 

------------
IA Summit 2007:  Enriching IA
Rich Information, Rich Interaction, Rich Relationships
March 22-26, 2007, Las Vegas, NV
www.iasummit.org
-----
When replying, please *trim your post* as much as possible.
*Plain text, please; NO Attachments

Searchable Archive at http://www.in
fo-arch.org/lists/sigia-l/




________________________________________
Sigia-l mailing list -- post to: Sigia-lasis.org
Changes to subscription: http://
mail.asis.org/mailman/listinfo/sigia-l

Re: Testing your own sites
country flaguser name
United States
2007-02-05 14:44:12
Michael Albers:

> advancing IA as a profession does require use of a full
usability lab.

It does????
 
> The focus is not getting a single project out the door;
it's figuring out what
> will work to improve out best practices (I know,
dangerous phrase) and test
> out new ideas.

Yep, you *are* an academic. 

> We hear that people don't like stories of "what
worked for me" as evidence as
> best practice since there are always so many other
factors.

Well, there *are* always so many other factors.

> Those other factors are always going to be there and
will always be a real
> pain, but at least with formal testing of the
fundamental concepts you use for
> creating the design, you can feel more confident that
the big issues will
> arise from those other factors and not from the design
itself.

Singling out factors to test is a difficult task in and of
itself, but I'm
not sure what relevance a "full usability lab" has
in that matter?
 
> The overall problem is highly complex and much more
than the sum of
> its parts.

Quite. But I'm still not sure what that has to do with the
*requirement* of
a "full usability lab"?

----
Ziya

"If I had asked my customers what they wanted,
they would have asked for a faster horse." -- Henry
Ford


------------
IA Summit 2007:  Enriching IA
Rich Information, Rich Interaction, Rich Relationships
March 22-26, 2007, Las Vegas, NV
www.iasummit.org
-----
When replying, please *trim your post* as much as possible.
*Plain text, please; NO Attachments

Searchable Archive at http://www.in
fo-arch.org/lists/sigia-l/




________________________________________
Sigia-l mailing list -- post to: Sigia-lasis.org
Changes to subscription: http://
mail.asis.org/mailman/listinfo/sigia-l

Re: Testing your own sites
user name
2007-02-05 15:23:21
On 2/6/07, Michael Albers <malbersmemphis.edu> wrote:
> Enter the academic use of the usability lab, doing
formal studies
> with statistical significance on the various design
features and
> methods to build the fundamental ideas for moving
design
> forward.  This can help determine if it was project A
or B that was
> the fluke.  The focus is not getting a single project
out the door;
> it's figuring out what will work to improve out best
practices (I
> know, dangerous phrase) and test out new ideas.  We
hear that people
> don't like stories of "what worked for me" as
evidence as best
> practice since there are always so many other factors. 
Those other
> factors are always going to be there and will always be
a real pain,
> but at least with formal testing of the fundamental
concepts you use
> for creating the design, you can feel more confident
that the big
> issues will arise from those other factors and not from
the design itself.

Mike,

we do "what worked for me" because it is the path
of least resistance
when we are too busy, too tired, too weary of fighting the
good fight
- sometimes we justify it by invoking the Holy Grail of best
practice
- but here, amongst ourselves, just we practitioners alone -
please
let us not in any way pretend that this is a good thing  I am not
saying that you are advocating a hollow best practice gloss
on a
rotten solution, but there are those about that do.

That said, "what worked for me" can be a good
thing if it does
coincide with those other factors (for example, "what
is the best
solution for the end users", "what is the best
solution within the
client budget", and "what is the best solution for
the client
organisation", which are not always the same thing when
working within
Government). It would be interesting to study how often
these do
coincide - how often an IA/Designer/etc delivers the
minimal
brainpower solution that is serendipitously also the
optimum.

Best regards, Andrew
------------
IA Summit 2007:  Enriching IA
Rich Information, Rich Interaction, Rich Relationships
March 22-26, 2007, Las Vegas, NV
www.iasummit.org
-----
When replying, please *trim your post* as much as possible.
*Plain text, please; NO Attachments

Searchable Archive at http://www.in
fo-arch.org/lists/sigia-l/




________________________________________
Sigia-l mailing list -- post to: Sigia-lasis.org
Changes to subscription: http://
mail.asis.org/mailman/listinfo/sigia-l

[1-3]

about | contact  Other archives ( Real Estate discussion Medical topics )