Relational Algrebra Operators

    [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:COMMENT-TABPANEL#
ACTION_12535385 ] 

STACK COMMENTED ON HADOOP-1608:
-------------------------------

COMMENTS ON VERSION 11 OF THIS PATCH:

+ IN BOOLEANEXPRESSION, YOU ARE DOING A SPLIT USING THE
STRINGS " OR " AND " AND ".  DOES THIS
IMPLY OR OR AND CAN NEVER APPEAR AT END OF A LINE?  (OR DOES
THE PARSER CONVERT NEWLINES TO SPACES?).  WHY NOT MAKE UNION
AND INTERSECTION FINAL STATIC STRINGS?
+ COMPARATOR HAS A   SUPPRESSWARNINGS("DEPRECATION").
 DO YOU NEED THIS?  SAME IN IDENTITYFILTERMAP. CAN YOU
UPDATE YOUR CODE SO IT USES NON-DEPRECATED API?
+ CLONING HAS ONE 'N' ONLY SO TABLECLONNING SHOULD BE
CLONINGTABLE (MAYBE BETTER NAMED AS CLONETABLE?).  IN THE
GETCONF, YOU HAVE AN IF/ELSE.  THE ELSE IS NOT NEEDED SINCE
YOU DO A RETURN OUT OF THE IF BLOCK.  ALSO IN TABLEJOIN AND
PROJECTION (IS PROJECTION A QUERY?  OR AN EXPRESSION?  SAME
FOR SELECTION.  SHOULD THERE BE A RELATIONAL OPERATORS
PACKAGE RATHER THAN QUERY AND EXPRESSION?  WHATS DIFFERENCE
BETWEEN A COMMAND AND AN EXPRESSION?  WHY IS SUBSTITUTE A
COMMAND AND PROJECTION A QUERY?).

GOOD STUFF EDWARD.

> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.1
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B~1~,B~2~,...,B~M~) IS A RELATION WITH DEGREE K=N+M
AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B ~2~,...,B
~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND R2;
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.

     [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:ALL-TABPANEL ]

EDWARD YOON UPDATED HADOOP-1608:
--------------------------------

    ATTACHMENT: PATCH_V12.TXT

 * ADDED ARBITRARY BOOLEAN EXPRESSION IN JOIN_CONDITION


HBASE> A = TABLE(MOVIELOG_TABLE);
HBASE> B = TABLE('PERSONINFO_TABLE');
HBASE> C = A.JOIN(A.PRODUCER: = B.ROW AND A.LENGTH >
100 OR A.INCOLOR = 'FALSE') AND B;
HBASE> SAVE C INTO TABLE('RESULT');


 * NOT YET IMPLEMENTED : ( A.PRODUCER: = B.ROW OR A.LENGTH
> 100 ) OR ( A.PRODUCER: = B.NAME: )
 ** I THINK IT NEEDS MAP/REDUCE PROCESSING TWICE.

> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.1
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT, PATCH_V12.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B~1~,B~2~,...,B~M~) IS A RELATION WITH DEGREE K=N+M
AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B ~2~,...,B
~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND R2;
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.

    [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:COMMENT-TABPANEL#
ACTION_12536618 ] 

EDWARD YOON COMMENTED ON HADOOP-1608:
-------------------------------------

AND, I WOULD LIKE TO HEAR YOUR OPINIONS ABOUT SHELL
SUB-PACKAGES FOR MAPRED/FILTER CLASSES AND HBASE
MAPRED/FILTER PACKAGES.


> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.1
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT, PATCH_V12.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B~1~,B~2~,...,B~M~) IS A RELATION WITH DEGREE K=N+M
AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B ~2~,...,B
~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND R2;
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.

     [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:ALL-TABPANEL ]

EDWARD YOON UPDATED HADOOP-1608:
--------------------------------

    DESCRIPTION: 
DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.

 * PROJECTION 
  ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A RELATION  
  ** RESULT = ? ~COLUMN_LIST~ (RELATION) 

HBASE > RESULT = RELATION.PROJECTION('YEAR','LEGNTH');
HBASE > SAVE RESULT INTO TABLE('RESULT');

 * SELECTION
  ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION

HBASE > RESULT = RELATION.SELECTION(LENGTH > 100 AND
STUDIONAME = 'FOX'); 
HBASE > SAVE RESULT INTO TABLE('RESULT');


 * GROUP
  ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE HANDLED IN
HADOOP-1658 ISSUE. 
 * ? JOIN
 ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~) AND
R2(B ~1~,B ~2~,...,B ~M~) IS A RELATION WITH DEGREE K=N+M
AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B ~2~,...,B
~M~) THAT SATISFY THE JOIN CONDITION

HBASE > R1 = TABLE('MOVIELOG_TABLE');
HBASE > R2 = TABLE('PERSONINFO_TABLE');
HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND R2; 
     OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND R2;
     OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW AND
R1.STUDIONAME = 'FOX' AND R2.OCCUPATION = 'SINGER');



  WAS:
DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.

 * PROJECTION 
  ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A RELATION  
  ** RESULT = ? ~COLUMN_LIST~ (RELATION) 

HBASE > RESULT = RELATION.PROJECTION('YEAR','LEGNTH');
HBASE > SAVE RESULT INTO TABLE('RESULT');

 * SELECTION
  ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION

HBASE > RESULT = RELATION.SELECTION(LENGTH > 100 AND
STUDIONAME = 'FOX'); 
HBASE > SAVE RESULT INTO TABLE('RESULT');


 * GROUP
  ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE HANDLED IN
HADOOP-1658 ISSUE. 
 * ? JOIN
 ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~) AND
R2(B~1~,B~2~,...,B~M~) IS A RELATION WITH DEGREE K=N+M AND
ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B ~2~,...,B ~M~)
THAT SATISFY THE JOIN CONDITION

HBASE > R1 = TABLE('MOVIELOG_TABLE');
HBASE > R2 = TABLE('PERSONINFO_TABLE');
HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND R2;
OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND R2;




UPDATE DESCRIPTION.


HBASE > R1 = TABLE('MOVIELOG_TABLE');
HBASE > R2 = TABLE('PERSONINFO_TABLE');
HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND R2; 
     OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND R2;
     OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW AND
R1.STUDIONAME = 'FOX' AND R2.OCCUPATION = 'SINGER');



> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.1
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT, PATCH_V12.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B ~1~,B ~2~,...,B ~M~) IS A RELATION WITH DEGREE
K=N+M AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B
~2~,...,B ~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; 
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND
R2;
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW AND
R1.STUDIONAME = 'FOX' AND R2.OCCUPATION = 'SINGER');
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.

    [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:COMMENT-TABPANEL#
ACTION_12536618 ] 

UDANAX EDITED COMMENT ON HADOOP-1608 AT 10/22/07 3:53 AM:
------------------------------------------------------------
---

AND, I WOULD LIKE TO HEAR YOUR OPINIONS ABOUT SHELL
SUB-PACKAGES FOR MAPRED/FILTER CLASSES AND HBASE
MAPRED/FILTER PACKAGES.
MAY I TOUCH HBASE MAPRED/FILTER PACKAGES?

      WAS (AUTHOR: UDANAX):
    AND, I WOULD LIKE TO HEAR YOUR OPINIONS ABOUT SHELL
SUB-PACKAGES FOR MAPRED/FILTER CLASSES AND HBASE
MAPRED/FILTER PACKAGES.

  
> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.1
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT, PATCH_V12.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B ~1~,B ~2~,...,B ~M~) IS A RELATION WITH DEGREE
K=N+M AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B
~2~,...,B ~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; 
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND
R2;
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW AND
R1.STUDIONAME = 'FOX' AND R2.OCCUPATION = 'SINGER');
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.

     [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:ALL-TABPANEL ]

EDWARD YOON UPDATED HADOOP-1608:
--------------------------------

    ATTACHMENT: PATCH_V13.TXT

> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.1
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT, PATCH_V12.TXT, PATCH_V13.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B ~1~,B ~2~,...,B ~M~) IS A RELATION WITH DEGREE
K=N+M AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B
~2~,...,B ~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; 
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND
R2;
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW AND
R1.STUDIONAME = 'FOX' AND R2.OCCUPATION = 'SINGER');
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.

     [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:ALL-TABPANEL ]

EDWARD YOON UPDATED HADOOP-1608:
--------------------------------

    AFFECTS VERSION/S:     (WAS: 0.14.1)
                       0.14.3
               STATUS: PATCH AVAILABLE  (WAS: OPEN)

I HAD SUCCESSFULLY TESTED MY PATCH ON MY COMPUTER.

> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.3
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT, PATCH_V12.TXT, PATCH_V13.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B ~1~,B ~2~,...,B ~M~) IS A RELATION WITH DEGREE
K=N+M AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B
~2~,...,B ~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; 
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND
R2;
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW AND
R1.STUDIONAME = 'FOX' AND R2.OCCUPATION = 'SINGER');
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.

     [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:ALL-TABPANEL ]

EDWARD YOON UPDATED HADOOP-1608:
--------------------------------

    AFFECTS VERSION/S:     (WAS: 0.14.3)
                       0.14.1
               STATUS: OPEN  (WAS: PATCH AVAILABLE)

> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.1
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT, PATCH_V12.TXT, PATCH_V13.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B ~1~,B ~2~,...,B ~M~) IS A RELATION WITH DEGREE
K=N+M AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B
~2~,...,B ~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; 
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND
R2;
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW AND
R1.STUDIONAME = 'FOX' AND R2.OCCUPATION = 'SINGER');
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.

     [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:ALL-TABPANEL ]

EDWARD YOON UPDATED HADOOP-1608:
--------------------------------

    STATUS: PATCH AVAILABLE  (WAS: OPEN)

> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.1
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT, PATCH_V12.TXT, PATCH_V13.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B ~1~,B ~2~,...,B ~M~) IS A RELATION WITH DEGREE
K=N+M AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B
~2~,...,B ~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; 
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND
R2;
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW AND
R1.STUDIONAME = 'FOX' AND R2.OCCUPATION = 'SINGER');
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.

    [
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608?PAGE=COM.A
TLASSIAN.JIRA.PLUGIN.SYSTEM.ISSUETABPANELS:COMMENT-TABPANEL#
ACTION_12540287 ] 

STACK COMMENTED ON HADOOP-1608:
-------------------------------

EDWARD:

I DO NOT UNDERSTAND WHAT YOU MEAN BY THE FOLLOWING IN YOUR
02/NOV/07 06:09 PM COMMENT: "I'LL IMPLEMENT RELATIONAL
ALGEBRA OPERATORS TO THE TENTATIVE LANGUAGE AND HQL BY
SUB-TASKS LIST SEQUENCE."

IN ORG.APACHE.HADOOP.HBASE.SHELL.ALGEBRA, TEST FOR OUTPUT
TABLE PRESENCE AND CREATION IF MISSING IS DUPLICATED CODE IN
SELECTION, PROJECTION, DUPLICATETABLE, ETC. I TRIED TO MOVE
THIS DUPLICATED CODE BACK UP INTO THE RELATIONALOPERATION
CLASS AS A UTILITY BUT NOTICED THEN IF TABLE ALREADY EXISTS,
WE DON'T CALL INITJOB BECAUSE WE RETURN EARLY  (SEE END OF
THE GETCONF IN DUPLICATETABLE FOR EXAMPLE).  IS RUNNING ONE
OF THESE OPERATORS A SECOND TIME, AFTER TABLE HAS BEEN
CREATED, A PROBLEM? HAVE YOU TRIED IT?

I DID NOT HAVE A MAPREDUCE CLUSTER RUNNING AND SO THE LAST
LINE HUNG FOR EVER (YOU SHOULD ADD TO HELP NEED FOR A
MAPREDUCE CLUSTER).

HBASE> AAA = TABLE('Y');
HBASE> AAA;
SYNTAX ERROR : TYPE 'HELP;' FOR USAGE.MESSAGE : ENCOUNTERED
";" AT LINE 1, COLUMN 5.
HBASE> SHOW AAA;
MISSING PARAMETERS. PLEASE CHECK 'SHOW' SYNTAX
HBASE> BBB = GROUP AAA BY ('X');   HBASE> SAVE BBB
INTO TABLE ('A');


NOTE, IT WOULD BE NICE IF YOU ENTERED A VARIABLE NAME ONLY
IF YOU GOT A DESCRIPTION OF THE VARIABLE CONTENT OR PERHAPS
DOING 'SHOW VARIABLE_NAME' OUTPUT SOME KIND OF DESCRIPTION.

I THEN STARTED UP A CLUSTER AND DID THE SIMPLEST OF
OPERATIONS:

HBASE> AAA = TABLE('X');
HBASE> SAVE AAA INTO TABLE(AAAAAA);
07/11/05 21:26:57 WARN MAPRED.JOBCLIENT: NO JOB JAR FILE
SET.  USER CLASSES MAY NOT BE FOUND. SEE JOBCONF(CLASS) OR
JOBCONF#SETJAR(STRING).JOB JOB_200711052125_0001 IS STILL
RUNNING........JOB FAILED.


JOB FAILED BECAUSE OF 'CAUSED BY:
JAVA.LANG.CLASSNOTFOUNDEXCEPTION:
ORG.APACHE.HADOOP.HBASE.MAPRED.TABLESPLIT'.  HOW DO YOU RUN
ON A CLUSTER EDWARD?  DO YOU COPY THE HBASE JAR INTO THE
HADOOP LIB DIR ALL OVER THE CLUSTER?  DOES HADOOP-1622 HELP
HERE?

ON JOB FAILURE, SHOULD THE TABLE BE REMOVED?  CURRENTLY, I
HAVE A NEW TABLE 'AAAAAA' WITH NOTHING IN IT.

THE OUTPUT OF GROUP, SELECTION, ETC. IS SAVED TO AN 'OUTPUT'
TABLE?

IT WOULD BE GOOD IF WE COULD GET INTO THE HELP LISTING
SOMEWHERE THE OPERATORS AND TYPES OF CONDITIONS ALLOWED ON
SELECTION (>, <, AND, OR, ETC.).

ONE LAST THING, HBASE SHELL (RELATIONAL) OPERATORS RUNNING
MAPREDUCE JOBS BEGINS TO IMPINGE ON PIG TERRITORY.   WE
SHOULD BE CAREFUL AND AVOID OVERLAP/DUPLICATING WORK.  WOULD
IT MAKE SENSE DOING FURTHER OPERATORS AS PIG USER DEFINED
FUNCTIONS?  (I SUPPOSE WE'LL BE ABLE TO TELL BETTER AFTER
PIG-6, THE HBASE LOAD/STORE, IS DONE.  SMILE).

OTHERWISE, PATCH LOOKS GOOD EDWARD.

 



> [HBASE SHELL] RELATIONAL ALGREBRA OPERATORS
> -------------------------------------------
>
>                 KEY: HADOOP-1608
>                 URL:
HTTPS://ISSUES.APACHE.ORG/JIRA/BROWSE/HADOOP-1608
>             PROJECT: HADOOP
>          ISSUE TYPE: IMPROVEMENT
>          COMPONENTS: CONTRIB/HBASE
>    AFFECTS VERSIONS: 0.14.1
>         ENVIRONMENT: ALL ENVIRONMENTS 
>            REPORTER: EDWARD YOON
>            PRIORITY: MINOR
>             FIX FOR: 0.16.0
>
>         ATTACHMENTS: PATCH_V01.TXT, PATCH_V02.TXT,
PATCH_V03.TXT, PATCH_V04.TXT, PATCH_V05.TXT, PATCH_V06.TXT,
PATCH_V07.TXT, PATCH_V08.TXT, PATCH_V09.TXT, PATCH_V10.TXT,
PATCH_V11.TXT, PATCH_V12.TXT, PATCH_V13.TXT, PATCH_V14.TXT,
PATCH_V15.TXT
>
>
> DEVELOPMENT OF RELATIONAL ALGEBRA OPERATORS HAS BEGUN.
>  * PROJECTION 
>   ** SELECTS A SUBSET OF THE COLUMNFAMILIES OF A
RELATION  
>   ** RESULT = ? ~COLUMN_LIST~ (RELATION) 
> 
> HBASE > RESULT =
RELATION.PROJECTION('YEAR','LEGNTH');
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * SELECTION
>   ** SEE : HADOOP-2003 ISSUE'S DESCRIPTION
> 
> HBASE > RESULT = RELATION.SELECTION(LENGTH > 100
AND STUDIONAME = 'FOX'); 
> HBASE > SAVE RESULT INTO TABLE('RESULT');
> 
>  * GROUP
>   ** MORE DETAILS ABOUT 'GROUP' OPERATION WILL BE
HANDLED IN HADOOP-1658 ISSUE. 
>  * ? JOIN
>  ** THE JOIN OF TWO RELATIONS R1(A ~1~,A ~2~,...,A ~N~)
AND R2(B ~1~,B ~2~,...,B ~M~) IS A RELATION WITH DEGREE
K=N+M AND ATTRIBUTES (A ~1~,A ~2~,...,A ~N~, B ~1~,B
~2~,...,B ~M~) THAT SATISFY THE JOIN CONDITION
> 
> HBASE > R1 = TABLE('MOVIELOG_TABLE');
> HBASE > R2 = TABLE('PERSONINFO_TABLE');
> HBASE > RESULT = R1.JOIN(R1.PRODUCER: = R2.ROW) AND
R2; 
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW) AND
R2;
>      OR RESULT = R1.JOIN(R1.ACTOR:HERO = R2.ROW AND
R1.STUDIONAME = 'FOX' AND R2.OCCUPATION = 'SINGER') AND R2;
> 

-- 
THIS MESSAGE IS AUTOMATICALLY GENERATED BY JIRA.
-
YOU CAN REPLY TO THIS EMAIL TO ADD A COMMENT TO THE ISSUE
ONLINE.