Skip to content

Latest commit

 

History

History
143 lines (76 loc) · 7.97 KB

README.md

File metadata and controls

143 lines (76 loc) · 7.97 KB

Homework Time - Google Assistant app

logo

My children (twins, 6 years old) are also early items and are elementary school students from next year. Before school They started going to the "Kumon" expression from early spring. I tried an assist mechanism to watch the homework done by the children on a daily basis with their families.

Kumon: After School Math & Reading Programs

Kumon Method Logo.svg By Kumon, Public domain

Features of Kumon - Kumon is not a method of teaching how to solve it, but by a learning method that solves problems of teaching materials with your own power, it fosters a self-affirmation that "can do if you do it", and even from unknown areas Develop the ability to challenge. Kumon expression is an education aiming at "pursuit of possibility" of each and every one. - From the official website

home-work-time-3.png

Utilizing original texts of Kumon, children learn the ability to learn by themselves.

Share with family

The time spent on homework is written by parent in case of preschool child. I tried this mechanism using electronic machine tools.

DSC_0132.jpg

I use a timer using Seeed's WioNode and Grove system. When Children press the button, the countdown of 10 minutes begins. They can measure the time it took by pushing the button at the end timing.(When more than 10 minutes have elapsed, the timer will automatically end)

The point sticking is that it is driven by 3 AA batteries because children use it everyday.When they turn on the power, it connects to the server set up by RaspberryPi with websocket.

The measured time can be sent to various services via IFTTT. By sending it to LINE, it is easy to share information with parents. Here we are sending to the line group we created for notification.

home-work-time-1.png

We can also check the time when the child finished our children's homework from the outside.

home-work-time-8.png

Write study time in Google spreadsheet. Mark it for more than 10 minutes.

GoogleAssistant

Homework Time - Google Assistant app - Youtube

I can check the learning situation from Google Assistant using Google spreadsheet API.

Video Caption Maker 2017-07-29 19-04-11.png

Call the spreadsheet data using api.ai's intents. Here we search by "name + date".Request Actions on Google for json data of "Name(Yolanda)) + Date (Today - July 29th, 2017)"

Since the date uses the entity of api.ai, it will draw out the intention of spoken words such as "yesterday" "day before yesterday" "three days ago".

Video Caption Maker 2017-07-29 19-04-37.png

In addition to just checking the date, you can specify the period and see if children can do homework within 10 minutes.

Video Caption Maker 2017-07-29 19-29-12.png

Search by "name + period". I will request Actions on Google for json data of " Name(Amanda) + period (Last week - July 17, 2017 to July 23, 2017) ".

I also use the api.ai entity for the period. We will pick up the period specified in spoken language as intended, such as "last week", "this month", "last month".

Video Caption Maker 2017-07-29 19-29-32.png

It tells the number of times the children were able to do their homework and the number of times they could not do it within hours.

home-work-time-2.png

In Kumon, it is not only that the answer is correct but also it will be the point to go to the next step, even if it is done within time.

Structure

Wio Node & IFTTT

wio-node (1).png

1. Wio Node

WioNode Grove - Button Grove - 4-Digit DisplaySet it up and enable the API.

2. websocket

In order to be able to receive Seeed's API, set up a server in RaspberryPi with node.js. I use websocket to receive button press data and send count down time. Together store the start time and end time in the array.

Homework-Time/RaspberryPi/wio-node/app.js

Homework-Time/RaspberryPi/wio-node/app2.js

3.PM2

Process management has been daemonized using PM2. When WioNode is turned on, websocket is connected. .

4.IFTTT

Make an account on IFTTT and make it available as a trigger for webhook.

5.webhook

I send the start and end dates of homework from RaspberryPi's server to the endpoint of webhook. With webhook as the trigger, we send the start and end time of received homework to LINE and Google spreadsheet.

Raspberry Pi & Google Assistant SDK

google-assistant.png

1.Google Assistant SDK

Google Assistant SDKInstall to RaspberryPi

2.Actions on Google

At Actions on Google, add a project and create a Google Assistant app. I used api.ai as a trigger of action this time.

Homework-Time/APIai/

3.Cloud Functions

Actions on Google can be run by installing the executable file at Cloud Functions on Google Cloud Platform.

Homework-Time/GCP/cloud_functions/

4.Sheets API v4

In order to use the data of Google spreadsheet, please use Sheets API v4. This time we will perform Oauth 2 authentication using the Pyhon library Python Quickstart

Homework-Time/RaspberryPi/spread-sheet/

5.ngrok

In order to connect to RaspberryPi from Cloud Functions, connect using ngrok. I started it from node.js for easy management.

Homework-Time/RaspberryPi/ngrok/

Summary

Children like the timer and are using it each time they do their homework.I hope that GoogleAssistant will be a good support.Ciao.

Additional notes: August 28, 2017

The Google Assistant iOS application can now be used in Japan.

Homework Time - Google Assistant app on iOS - YouTube

homeworktime_ios1

It supports not only character input but also audio input.

homeworktime_ios2

I can hardly wait for Japanese support for Actions on Google. Ciao.

The MIT License Copyright (c) 2017 Studio Identical Twins