Matching Items (4)
Filtering by

Clear all filters

161939-Thumbnail Image.png
Description
Traditional Reinforcement Learning (RL) assumes to learn policies with respect to reward available from the environment but sometimes learning in a complex domain requires wisdom which comes from a wide range of experience. In behavior based robotics, it is observed that a complex behavior can be described by a combination

Traditional Reinforcement Learning (RL) assumes to learn policies with respect to reward available from the environment but sometimes learning in a complex domain requires wisdom which comes from a wide range of experience. In behavior based robotics, it is observed that a complex behavior can be described by a combination of simpler behaviors. It is tempting to apply similar idea such that simpler behaviors can be combined in a meaningful way to tailor the complex combination. Such an approach would enable faster learning and modular design of behaviors. Complex behaviors can be combined with other behaviors to create even more advanced behaviors resulting in a rich set of possibilities. Similar to RL, combined behavior can keep evolving by interacting with the environment. The requirement of this method is to specify a reasonable set of simple behaviors. In this research, I present an algorithm that aims at combining behavior such that the resulting behavior has characteristics of each individual behavior. This approach has been inspired by behavior based robotics, such as the subsumption architecture and motor schema-based design. The combination algorithm outputs n weights to combine behaviors linearly. The weights are state dependent and change dynamically at every step in an episode. This idea is tested on discrete and continuous environments like OpenAI’s “Lunar Lander” and “Biped Walker”. Results are compared with related domains like Multi-objective RL, Hierarchical RL, Transfer learning, and basic RL. It is observed that the combination of behaviors is a novel way of learning which helps the agent achieve required characteristics. A combination is learned for a given state and so the agent is able to learn faster in an efficient manner compared to other similar approaches. Agent beautifully demonstrates characteristics of multiple behaviors which helps the agent to learn and adapt to the environment. Future directions are also suggested as possible extensions to this research.
ContributorsVora, Kevin Jatin (Author) / Zhang, Yu (Thesis advisor) / Yang, Yezhou (Committee member) / Praharaj, Sarbeswar (Committee member) / Arizona State University (Publisher)
Created2021
170654-Thumbnail Image.jpg
Description

Urea is an added value chemical with wide applications in the industry and agriculture. The release of urea waste to the environment affects ecosystem health despite its low toxicity. Online monitoring of urea for industrial applications and environmental health is an unaddressed challenge. Electroanalytical techniques can be a smart integrated

Urea is an added value chemical with wide applications in the industry and agriculture. The release of urea waste to the environment affects ecosystem health despite its low toxicity. Online monitoring of urea for industrial applications and environmental health is an unaddressed challenge. Electroanalytical techniques can be a smart integrated solution for online monitoring if sensors can overcome the major barrier associated with long-term stability. Mixed metal oxides have shown excellent stability in environmental conditions with long lasting operational lives. However, these materials have been barely explored for sensing applications. This work presents a proof of concept that demonstrates the applicability of an indirect electroanalytical quantification method of urea. The use of Ti/RuO2-TiO2-SnO2 dimensional stable anode (DSA®) can provide accurate and sensitive quantification of urea in aqueous samples exploiting the excellent catalytic properties of DSA® on the electrogeneration of active chlorine species. The cathodic reduction of accumulated HClO/ClO− from anodic electrogeneration presented a direct relationship with urea concentration. This novel method can allow urea quantification with a competitive LOD of 1.83 × 10−6 mol L−1 within a linear range of 6.66 × 10−6 to 3.33 × 10−4 mol L−1 of urea concentration.

Created2021-05-15
162019-Thumbnail Image.png
Description

Cities in the Global South face rapid urbanization challenges and often suffer an acute lack of infrastructure and governance capacities. Smart Cities Mission, in India, launched in 2015, aims to offer a novel approach for urban renewal of 100 cities following an area‐based development approach, where the use of ICT

Cities in the Global South face rapid urbanization challenges and often suffer an acute lack of infrastructure and governance capacities. Smart Cities Mission, in India, launched in 2015, aims to offer a novel approach for urban renewal of 100 cities following an area‐based development approach, where the use of ICT and digital technologies is particularly emphasized. This article presents a critical review of the design and implementation framework of this new urban renewal program across selected case‐study cities. The article examines the claims of the so‐called “smart cities” against actual urban transformation on‐ground and evaluates how “inclusive” and “sustainable” these developments are. We quantify the scale and coverage of the smart city urban renewal projects in the cities to highlight who the program includes and excludes. The article also presents a statistical analysis of the sectoral focus and budgetary allocations of the projects under the Smart Cities Mission to find an inherent bias in these smart city initiatives in terms of which types of development they promote and the ones it ignores. The findings indicate that a predominant emphasis on digital urban renewal of selected precincts and enclaves, branded as “smart cities,” leads to deepening social polarization and gentrification. The article offers crucial urban planning lessons for designing ICT‐driven urban renewal projects, while addressing critical questions around inclusion and sustainability in smart city ventures.`

ContributorsPraharaj, Sarbeswar (Author)
Created2021-05-07
190-Thumbnail Image.png
Description

Attitudes and habits are extremely resistant to change, but a disruption of the magnitude of the COVID-19 pandemic has the potential to bring long-term, massive societal changes. During the pandemic, people are being compelled to experience new ways of interacting, working, learning, shopping, traveling, and eating meals. Going forward, a

Attitudes and habits are extremely resistant to change, but a disruption of the magnitude of the COVID-19 pandemic has the potential to bring long-term, massive societal changes. During the pandemic, people are being compelled to experience new ways of interacting, working, learning, shopping, traveling, and eating meals. Going forward, a critical question is whether these experiences will result in changed behaviors and preferences in the long term. This paper presents initial findings on the likelihood of long-term changes in telework, daily travel, restaurant patronage, and air travel based on survey data collected from adults in the United States in Spring 2020. These data suggest that a sizable fraction of the increase in telework and decreases in both business air travel and restaurant patronage are likely here to stay. As for daily travel modes, public transit may not fully recover its pre-pandemic ridership levels, but many of our respondents are planning to bike and walk more than they used to. These data reflect the responses of a sample that is higher income and more highly educated than the US population. The response of these particular groups to the COVID-19 pandemic is perhaps especially important to understand, however, because their consumption patterns give them a large influence on many sectors of the economy.

Created2020-09-03