Scenarios for AI in Digital Media - Revision history

J Dobies: /* Scenario 4 */

2007-09-10T17:35:02Z

Scenario 4

J Dobies: /* Scenario 4 */

2007-09-10T16:53:56Z

Scenario 4

J Dobies: /* Scenario 3 */

2007-09-09T06:15:09Z

Scenario 3

J Dobies at 15:10, 8 September 2007

2007-09-08T15:10:26Z

J Dobies at 05:20, 8 September 2007

2007-09-08T05:20:52Z

J Dobies: /* Scenario 5 */

2007-09-08T01:43:05Z

Scenario 5

J Dobies: /* Scenario 5 */

2007-09-08T01:42:44Z

Scenario 5

J Dobies: /* Scenario 1 */

2007-09-08T01:41:38Z

Scenario 1

J Dobies: /* Scenario 3 */

2007-09-08T01:23:10Z

Scenario 3

J Dobies: /* Scenario 2 */

2007-09-08T00:38:46Z

Scenario 2

@@ Line 29: / Line 29: @@
 ==Scenario 4==
 <p>You create a online system that allows a user to attach tags to a movie file they upload. These movie files become nodes that are able to be connected to each other to create a branching non-linear story path. You want to allow the user to find paths based on length as well as creating a system that allows the user to make a short sentence that will be used to search for a path that will most resemble the sentence. How can AI help to solve this pathfinding?</p>
-<p>The English language has many words all have the same or similar meaning. Because of this, it becomes important to break down these words using [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] and then gather all the synonyms for each word in order to create a large database of similar words to compare to the tags. This would help to find the most accurate path. [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] (NLP) is s subsection of [[Machine Learning]]. An example of node based video automated video editing is [http://philbertanddodge.com Philbert and Dodge] </p>
+<p>The English language has many words all have the same or similar meaning. Because of this, it becomes important to break down these words using [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] and then gather all the synonyms for each word in order to create a large database of similar words to compare to the tags. This would help to find the most accurate path. [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] (NLP) is s subsection of [[Machine Learning]]. An example of node based automated video editing is [http://philbertanddodge.com Philbert and Dodge] </p>
 ==Scenario 5==

@@ Line 29: / Line 29: @@
 ==Scenario 4==
 <p>You create a online system that allows a user to attach tags to a movie file they upload. These movie files become nodes that are able to be connected to each other to create a branching non-linear story path. You want to allow the user to find paths based on length as well as creating a system that allows the user to make a short sentence that will be used to search for a path that will most resemble the sentence. How can AI help to solve this pathfinding?</p>
-<p>The English language has many words all have the same or similar meaning. Because of this, it becomes important to break down these words using [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] and then gather all the synonyms for each word in order to create a large database of similar words to compare to the tags. This would help to find the most accurate path. [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] (NLP) is s subsection of [[Machine Learning]]</p>
+<p>The English language has many words all have the same or similar meaning. Because of this, it becomes important to break down these words using [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] and then gather all the synonyms for each word in order to create a large database of similar words to compare to the tags. This would help to find the most accurate path. [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] (NLP) is s subsection of [[Machine Learning]]. An example of node based video automated video editing is [http://philbertanddodge.com Philbert and Dodge] </p>
 ==Scenario 5==

@@ Line 22: / Line 22: @@
 ==Scenario 3==
 [[Image:CarHit.jpg |thumb|right| A still from endorphin showing a character being hit with a car.A sample video can be seen [http://gicl.cs.drexel.edu/wiki-data/images/e/ef/CarHitEndorphin.mov here.]]]
-<p>You wish to create a 3d animation where you want your character to respond to real world physics at certain points while adhering to your animation at other points in time. For example you want a character to be running down the road, get hit by a car, and then land safely on its feet. You want to be able to control the animation before the character was hit by the car and once it lands however in between them you wish for physics to take command as long as it can achieve the starting pose you defined after it hits the road. While the character is in air you want to contrain him so that he has a behavior to attempt to achieve (such as do a flip or attempt to grab something). How can A.I help here?</p>
+<p>You wish to create a 3d animation where you want your character to respond to real world physics at certain points while adhering to your animation at other points in time. For example you want a character to be running down the road, get hit by a car, and then land safely on its feet. You want to be able to control the animation before the character was hit by the car and once it lands however in between them you wish for physics to take command as long as it can achieve the starting pose you defined after it hits the road. While the character is in air you want to constrain him so that he has a behavior to attempt to achieve (such as do a flip or attempt to grab something). How can A.I help here?</p>
-<p>Because there is not one solution that provides an exact solution to this problem it is hard to come to a solution for this dilemma. Through the use of [http://en.wikipedia.org/wiki/Genetic_algorithm genetic algorithms] the computer can discover a solution that works [http://en.wikipedia.org/wiki/Genetic_algorithm Genetic algorithms] are a subsection of [[Evolutionary Computation]]. A system like this is the basis of Natural Motion's [http://www.naturalmotion.com/ Endorphin].
+<p>A system like this is the basis of Natural Motion's [http://www.naturalmotion.com/ Endorphin].
-</p>
+[http://www.naturalmotion.com/ Endorphin] uses adaptive behaviors which allows for interaction between characters. These behaviors set goals for characters to achieve. These goals can range from attempting to jump and grab an object to balancing while standing up. The animator can apply forces on top of these behaviors which the character will respond to while still attempting to achieve the goal. The animator can also have collide with the character instead of just using invisible forces. This system also allows for the constraining of objects with weight to the characters which will affect the character's motions. Animation constraints that are affected by real world physics was suggested by Witken and Cass's theories on  [http://www.cs.cmu.edu/~aw/pdf/spacetime.pdf spacetime constraints].Because there is not one solution that provides an exact solution to this problem it is hard to come to a solution for this dilemma. Through the use of [http://en.wikipedia.org/wiki/Genetic_algorithm genetic algorithms] the computer can discover a solution that works best. [http://en.wikipedia.org/wiki/Genetic_algorithm Genetic algorithms] are a subsection of [[Evolutionary Computation]].
-<p>
-[http://www.naturalmotion.com/ Endorphin] uses adaptive behaviors which allows for interaction between characters. These behaviors set goals for characters to achieve. These goals can range from attempting to jump and grab an object to balancing while standing up. The animator can apply forces on top of these behaviors as well as having objects collide with the character. This system also allows for the constraining of objects to the characters with weight which will affect the character's gait. Animation constraints that are affected by real world physics was suggested by Witken and Cass's theories on  [http://www.cs.cmu.edu/~aw/pdf/spacetime.pdf spacetime constraints]
 </p>

@@ Line 1: / Line 1: @@
-<p>Games, movies, animations and websites all rely on both computer scientists and digital media artists to create a good final project. The role for computer scientists is not limited to just the creation of the programs used by digital media artists. [http://en.wikipedia.org/wiki/Artificial_intelligence Artificial Intelligence] is being used in many capacities for each of these media. Below are scenarios where the roles of digital media artists and computer scientists begin to intertwine.
+<p>Game, movie, animation and website creation all rely on both computer scientists and digital media artists to create a good final project. The role for computer scientists is not limited to just the creation of the programs used by digital media artists. [http://en.wikipedia.org/wiki/Artificial_intelligence Artificial Intelligence] is being used in many capacities for each of these media. Below are scenarios where the roles of digital media artists and computer scientists begin to intertwine.
 </p>
 ==Scenario 1==
-<p>[[Image:RomeTW.jpg |thumb|right| [http://en.wikipedia.org/wiki/Rome:_Total_War Rome: Total War] is a computer game that has large computer controlled armies battle each other]]You are creating 3d real times strategy (RTS) game. This game allows for the user to create a large army by building up different squadrons of various soldiers (archers, footman, horseman etc.) When the soldiers are created you want the user to be able to attack a computer controlled fortification or army. To make the game more enjoyable you wish the army to adapt to the play style of the user and be able to learn from their actions to better prepare them in future encounters. How can A.I help in this situation?</p>
+<p>[[Image:RomeTW.jpg |thumb|right| [http://en.wikipedia.org/wiki/Rome:_Total_War Rome: Total War] is a computer game that has large computer controlled armies battle each other.]]
 <p> Some examples of RTS Games are:<br>
 [http://en.wikipedia.org/wiki/Warcraft_III WarCraft] by Blizzard Entertainment<br>
@@ Line 8: / Line 9: @@
 [http://en.wikipedia.org/wiki/Rome:_Total_War Rome: Total War]<br>
 </p>
-<p>A.I. would be able to handle the group behavior necessary to have a large army respond to each other and their environments. This would be done through the use of agent technologies similar in method to [http://www.massivesoftware.com/index.php Massive] and the [http://www.cs.ucla.edu/~dt/alife.html Artificial Life] project. These technologies use [[Fuzzy Logic]] to allow agents to react similarly to humans.
+<p>A.I. would be able to handle the group behavior necessary to have a large army respond to each other and their environments. This would be done through the use of agent technologies similar in method to [http://www.massivesoftware.com/index.php Massive] and the [http://www.cs.ucla.edu/~dt/alife.html Artificial Life] project. These technologies use [[Fuzzy Logic]] to allow agents to react similarly to humans through the use of non-harsh boundaries to make decisions.The ability for software to learn from users makes games more enjoyable and tailors the experience to each user. This has been harnessed in many games including [http://en.wikipedia.org/wiki/Re-Volt <i> Revolt</i>] and [http://en.wikipedia.org/wiki/Command_and_Conquer:_Renegade <i>Command and Conquer: Renegade</i> ]This A.I. technology harnesses the power of [[Machine Learning]]</p>
 The ability for software to learn from users makes games more enjoyable and tailors the experience to each user. This has been harnessed in many games including [http://en.wikipedia.org/wiki/Re-Volt <i> Revolt</i>] and [http://en.wikipedia.org/wiki/Command_and_Conquer:_Renegade <i>Command and Conquer: Renegade</i> ]This A.I. technology harnesses the power of [[Machine Learning]]</p>
 ==Scenario 2==
-<p>[[Image:Massive.jpg |thumb|right| An example of an AI army created with Massive for <i>Lord of the Rings</i>.]]You are creating a 3d animation that requires you to have a scene of thousands of character in battle in several shots. Due to the time constraints you do not have the ability to hand animate each character. You need a system that allows you to have many characters use animations you create to interact with each other without seeming repetitive and all responding the exact same way. How can A.I. help in this situation?</p>
+<p>[[Image:Massive.jpg |thumb|right| An example of an AI army created with Massive for <i>Lord of the Rings</i>.]]You are creating a 3d animation that requires you to have a scene of thousands of character in battle in several shots. Due to the time constraints you do not have the necessary time to hand animate each character's action. You need a system that allows you to have many characters use several short animations you create to interact and battle with each other without seeming repetitive and all responding the exact same way. How can A.I. help in this situation?</p>
 <p>This has been a dilemma for many animation and visual effects studios. Hand animating individual soldiers in an army takes an extreme amount of time. A.I. would be a great solution to this problem. [http://en.wikipedia.org/wiki/Software_agent Agent technology] would allow you to create agents that would respond to each other and the environment. This would require that you create an animation (or multiple animations) for each action that an agent can go through. These actions would be called by the agent's brain. The agent brain uses [[Fuzzy Logic]] in order to make decisions as to what action should be called.</p>
 <p>
-One of the biggest developments in large scale character interaction was the AI system created for use in the <i> Lord of the Rings</i> films, [http://www.massivesoftware.com/ Massive Software]. It has been used in feature films (<i>Lord of the Rings, King Kong, Chronicles of Narnia</i>) and commercials to simulate lifelike crowds that are able to be controlled. This system allows for the creation of agents that respond to their environment and each other. These responses are determined through the programming of the 'brain'. This 'brain' is created through the definition of parameters using fuzzy logic. Through the evaluation of these parameters the brain is able to determine and action (or blending of actions) for each agent. An action is an animation (key framed or motion captured). These actions are all created by digital artists and then brought into the system for use. Action trees are created to establish connections between animations to allow for the transition from one action to another. These transitions can range from change from one animation to another, to traveling through several short animations to arrive at a final goal. The action tree also is responsible for creating loops within the action or defining branching points for changes mid animation. Because of the direct connection between animation and programming it is important for the digital artists and the computer programmers to work closely to develop both the brain and the action tree in order to ensure an accurate final product.</p>
+One of the biggest developments in large scale character interaction was the AI system created for use in the <i> Lord of the Rings</i> films, [http://www.massivesoftware.com/ Massive Software]. It has been used in feature films (<i>Lord of the Rings, King Kong, Chronicles of Narnia</i>) and commercials to simulate lifelike crowds that are able to be controlled. This system allows for the creation of agents that respond to their environment and each other. These responses are determined through the programming of the 'brain'. This 'brain' is created through the definition of parameters using [[Fuzzy Logic]]. Through the evaluation of these parameters the brain is able to determine and action (or blending of actions) for each agent. An action is an animation (key framed or motion captured). These actions are all created by digital artists and then brought into the system for use. Action trees are created to establish connections between animations to allow for the transition from one action to another. These transitions can range from change from one animation to another, to traveling through several short animations to arrive at a final goal. The action tree also is responsible for creating loops within the action or defining branching points for changes mid animation. Because of the direct connection between animation and programming it is important for the digital artists and the computer programmers to work closely to develop both the brain and the action tree in order to ensure an accurate final product.</p>
 ==Scenario 3==
-[[Image:CarHit.jpg |thumb|right| Still from endorphin showing a character being hit with a car.A sample video can be seen [http://gicl.cs.drexel.edu/wiki-data/images/e/ef/CarHitEndorphin.mov here.]]]
+[[Image:CarHit.jpg |thumb|right| A still from endorphin showing a character being hit with a car.A sample video can be seen [http://gicl.cs.drexel.edu/wiki-data/images/e/ef/CarHitEndorphin.mov here.]]]
-<p>You wish to create a 3d animation that where you want your character to respond to real world physics at certain points in while adhering to your animation at other points in time. For example you want a character to be running down the road, get hit by a car, and then land safely on its feet. You want to be able to control the animation before the character was hit by the car and once it lands however in between them you wish for physics to take command as long as it can achieve the starting pose you defined after it hits the road. How can A.I help here?</p>
+<p>You wish to create a 3d animation where you want your character to respond to real world physics at certain points while adhering to your animation at other points in time. For example you want a character to be running down the road, get hit by a car, and then land safely on its feet. You want to be able to control the animation before the character was hit by the car and once it lands however in between them you wish for physics to take command as long as it can achieve the starting pose you defined after it hits the road. While the character is in air you want to contrain him so that he has a behavior to attempt to achieve (such as do a flip or attempt to grab something). How can A.I help here?</p>
-<p>Because there is no one solution that provides an exact solution to this problem it is hard to come to a solution for this dilemma. Through the use of [http://en.wikipedia.org/wiki/Genetic_algorithm genetic algorithms] the computer can discover a solution that works [http://en.wikipedia.org/wiki/Genetic_algorithm Genetic algorithms] are a subsection of [[Evolutionary Computation]]. A system like this is the basis of Natural Motion's [http://www.naturalmotion.com/ Endorphin].
+<p>Because there is not one solution that provides an exact solution to this problem it is hard to come to a solution for this dilemma. Through the use of [http://en.wikipedia.org/wiki/Genetic_algorithm genetic algorithms] the computer can discover a solution that works [http://en.wikipedia.org/wiki/Genetic_algorithm Genetic algorithms] are a subsection of [[Evolutionary Computation]]. A system like this is the basis of Natural Motion's [http://www.naturalmotion.com/ Endorphin].
 </p>
 <p>
-[http://www.naturalmotion.com/ Endorphin] uses adaptive behaviors which allows for interaction between characters. These behaviors set goals for a characters to achieve. These goals can range from attempting to jump and grab an object to balancing while standing up. The animator can apply forces on top of these behaviors as well as having objects collide with the character. This system also allows for the constraining of objects to the characters with weight which will affect the character's gait. This system is evolved from Witken and Cass's theories on  [http://www.cs.cmu.edu/~aw/pdf/spacetime.pdf spacetime constraints]
+[http://www.naturalmotion.com/ Endorphin] uses adaptive behaviors which allows for interaction between characters. These behaviors set goals for characters to achieve. These goals can range from attempting to jump and grab an object to balancing while standing up. The animator can apply forces on top of these behaviors as well as having objects collide with the character. This system also allows for the constraining of objects to the characters with weight which will affect the character's gait. Animation constraints that are affected by real world physics was suggested by Witken and Cass's theories on  [http://www.cs.cmu.edu/~aw/pdf/spacetime.pdf spacetime constraints]
 </p>
 ==Scenario 4==
 <p>You create a online system that allows a user to attach tags to a movie file they upload. These movie files become nodes that are able to be connected to each other to create a branching non-linear story path. You want to allow the user to find paths based on length as well as creating a system that allows the user to make a short sentence that will be used to search for a path that will most resemble the sentence. How can AI help to solve this pathfinding?</p>
-<p>Because the English language has many words with the same meaning. Because of this, it becomes important to break down these words using [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] and then gather all the synonyms to create a large database of similar words to compare to the tags in order to find a path. [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] (NLP) is s subsection of [[Machine Learning]]</p>
+<p>The English language has many words all have the same or similar meaning. Because of this, it becomes important to break down these words using [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] and then gather all the synonyms for each word in order to create a large database of similar words to compare to the tags. This would help to find the most accurate path. [http://en.wikipedia.org/wiki/Natural_language_processing Natural Language Processing] (NLP) is s subsection of [[Machine Learning]]</p>
 ==Scenario 5==
-<p> [[Image:Diggumlogo.jpg |thumb|right| <i> Planet Diggum</i> is a game designed by Drexel University students that allows multiple users to interact with a [http://en.wikipedia.org/wiki/Multi-touch multi-touch display]]]You wish to make a installation game that will allow for multiple users to interact at the same time. This piece should allow multiple users to interact with each other over a single screen without the need for any input device (mouse, joystick, keyboard etc). Also, to make the game more interesting you want to remove the need for any graphical interfaces to interact with the program but instead be able to use different gestures in order to perform different actions. What would AI be able to offer as a solution to this problem? </p>
+<p> [[Image:Diggumlogo.jpg |thumb|right| <i> Planet Diggum</i> is a game designed by Drexel University students that allows multiple users to interact with a [http://en.wikipedia.org/wiki/Multi-touch multi-touch display] to control characters on the screen.]]
 <p> A [http://en.wikipedia.org/wiki/Multi-touch multi-touch display] would be an ideal solution for the hardware issue of this dilemma. These units are touch sensitive displays that allow for multiple points of contact simultaneously. To allow for multiple users, AI must be used to differentiate each one based on proximity and time of touch. This not only allows for a more intuitive interaction but also provides the ability for multiple users to interact with each other and work simultaneously on one system. [http://en.wikipedia.org/wiki/Gesture_recognition Gesture recognition] is an important part for making this system intuitive. This can be done through training the computer program to recognize each of the gestures by harnessing the techniques of [[Machine Learning]].</p>

@@ Line 1: / Line 1: @@
-Computer Science and Digital Media are interrelated in many ways. Below are some scenarios where AI and Digital Media intertwine.
+<p>Games, movies, animations and websites all rely on both computer scientists and digital media artists to create a good final project. The role for computer scientists is not limited to just the creation of the programs used by digital media artists. [http://en.wikipedia.org/wiki/Artificial_intelligence Artificial Intelligence] is being used in many capacities for each of these media. Below are scenarios where the roles of digital media artists and computer scientists begin to intertwine.
 ==Scenario 1==
 <p>[[Image:RomeTW.jpg |thumb|right| [http://en.wikipedia.org/wiki/Rome:_Total_War Rome: Total War] is a computer game that has large computer controlled armies battle each other]]You are creating 3d real times strategy (RTS) game. This game allows for the user to create a large army by building up different squadrons of various soldiers (archers, footman, horseman etc.) When the soldiers are created you want the user to be able to attack a computer controlled fortification or army. To make the game more enjoyable you wish the army to adapt to the play style of the user and be able to learn from their actions to better prepare them in future encounters. How can A.I help in this situation?</p>

@@ Line 33: / Line 33: @@
 ==Scenario 5==
-<p> [[Image:Diggumlogo.jpg |thumb|right| <i> Planet Diggum</i> is a game designed by Drexel University students that allows multiple users to interact with a [http://en.wikipedia.org/wiki/Multi-touch multi-touch display] more on the project can be read [http://justindobies.com/diefenbach_diggums3.pdf here]]]You wish to make a installation game that will allow for multiple users to interact at the same time. This piece should allow multiple users to interact with each other over a single screen without the need for any input device (mouse, joystick, keyboard etc). Also, to make the game more interesting you want to remove the need for any graphical interfaces to interact with the program but instead be able to use different gestures in order to perform different actions. What would AI be able to offer as a solution to this problem? </p>
+<p> [[Image:Diggumlogo.jpg |thumb|right| <i> Planet Diggum</i> is a game designed by Drexel University students that allows multiple users to interact with a [http://en.wikipedia.org/wiki/Multi-touch multi-touch display]]You wish to make a installation game that will allow for multiple users to interact at the same time. This piece should allow multiple users to interact with each other over a single screen without the need for any input device (mouse, joystick, keyboard etc). Also, to make the game more interesting you want to remove the need for any graphical interfaces to interact with the program but instead be able to use different gestures in order to perform different actions. What would AI be able to offer as a solution to this problem? </p>
 <p> A [http://en.wikipedia.org/wiki/Multi-touch multi-touch display] would be an ideal solution for the hardware issue of this dilemma. These units are touch sensitive displays that allow for multiple points of contact simultaneously. To allow for multiple users, AI must be used to differentiate each one based on proximity and time of touch. This not only allows for a more intuitive interaction but also provides the ability for multiple users to interact with each other and work simultaneously on one system. [http://en.wikipedia.org/wiki/Gesture_recognition Gesture recognition] is an important part for making this system intuitive. This can be done through training the computer program to recognize each of the gestures by harnessing the techniques of [[Machine Learning]].</p>